alibaba

alibaba

Alibaba Open Source

Member Since 9 years ago

Hangzhou, China

Experience Points
0
follower
Lessons Completed
0
follow
Best Reply Awards
410
repos
Activity
Jan
19
9 hours ago
Activity icon
issue

yushui16389 issue comment alibaba/MongoShake

yushui16389
yushui16389

全量同步完成后,增量同步没有新数据写入目的库

mongoshake版本:v2.6.5 mongodb版本:v4.2

源库不断写入新数据的情况下,开启一个mongoshake,用all模式把数据从源库同步至目的库 全量同步完成后进入增量同步,此时源库仍在不断写入新数据,但是目标库的数据不再增长。 查看日志,lsn_ckpt一直在更新为最新的时间,但是lsn_ack仍然停留在最初的时间。日志如下:

[2022/01/19 16:35:30 CST] [INFO] [name=shard2, stage=incr, get=124571, filter=124380, write_success=0, tps=0, ckpt_times=5, lsn_ckpt={7054833836399525984[1642581503, 96], 2022-01-19 16:38:23}, lsn_ack={0[0, 0], 1970-01-01 08:00:00}]]
[2022/01/19 16:35:30 CST] [INFO] [name=shard3, stage=incr, get=63664, filter=63664, write_success=0, tps=0, ckpt_times=4, lsn_ckpt={7054833084780249090[1642581328, 2], 2022-01-19 16:35:28}, lsn_ack={0[0, 0], 1970-01-01 08:00:00}]]
[2022/01/19 16:35:35 CST] [INFO] [name=shard1, stage=incr, get=63008, filter=63008, write_success=0, tps=0, ckpt_times=4, lsn_ckpt={7054833119139987469[1642581336, 13], 2022-01-19 16:35:36}, lsn_ack={0[0, 0], 1970-01-01 08:00:00}]]
[2022/01/19 16:35:35 CST] [INFO] [name=shard2, stage=incr, get=124595, filter=124571, write_success=0, tps=0, ckpt_times=5, lsn_ckpt={7054833836399525984[1642581503, 96], 2022-01-19 16:38:23}, lsn_ack={0[0, 0], 1970-01-01 08:00:00}]]
[2022/01/19 16:35:35 CST] [INFO] [name=shard3, stage=incr, get=63664, filter=63664, write_success=0, tps=0, ckpt_times=4, lsn_ckpt={7054833084780249090[1642581328, 2], 2022-01-19 16:35:28}, lsn_ack={0[0, 0], 1970-01-01 08:00:00}]]
[2022/01/19 16:35:40 CST] [INFO] Syncer[shard1] try to update checkpoint mandatory from 7054833119139987469[1642581336, 13] to 7054833930888806419[1642581525, 19]
[2022/01/19 16:35:40 CST] [INFO] Syncer[shard1] waiting last checkpoint[7054833930888806419[1642581525, 19]] updated
[2022/01/19 16:35:40 CST] [INFO] Syncer[shard1] last checkpoint[7054833930888806419[1642581525, 19]] updated [false]
[2022/01/19 16:35:40 CST] [INFO] shard1 Record new checkpoint success [1642581525]
[2022/01/19 16:35:40 CST] [INFO] CheckpointOperation write success. updated from 7054833119139987469[1642581336, 13] to 7054833930888806419[1642581525, 19]
[2022/01/19 16:35:40 CST] [INFO] [name=shard1, stage=incr, get=63009, filter=63009, write_success=0, tps=0, ckpt_times=5, lsn_ckpt={7054833930888806419[1642581525, 19], 2022-01-19 16:38:45}, lsn_ack={0[0, 0], 1970-01-01 08:00:00}]]
[2022/01/19 16:35:40 CST] [INFO] [name=shard2, stage=incr, get=124742, filter=124571, write_success=0, tps=0, ckpt_times=5, lsn_ckpt={7054833836399525984[1642581503, 96], 2022-01-19 16:38:23}, lsn_ack={0[0, 0], 1970-01-01 08:00:00}]]
[2022/01/19 16:35:40 CST] [INFO] [name=shard3, stage=incr, get=63665, filter=63664, write_success=0, tps=0, ckpt_times=4, lsn_ckpt={7054833084780249090[1642581328, 2], 2022-01-19 16:35:28}, lsn_ack={0[0, 0], 1970-01-01 08:00:00}]]
[2022/01/19 16:35:41 CST] [INFO] Syncer[shard3] try to update checkpoint mandatory from 7054833084780249090[1642581328, 2] to 7054833935183773698[1642581526, 2]
[2022/01/19 16:35:41 CST] [INFO] Syncer[shard3] waiting last checkpoint[7054833935183773698[1642581526, 2]] updated
[2022/01/19 16:35:41 CST] [INFO] Syncer[shard3] last checkpoint[7054833935183773698[1642581526, 2]] updated [false]
[2022/01/19 16:35:41 CST] [INFO] shard3 Record new checkpoint success [1642581526]
[2022/01/19 16:35:41 CST] [INFO] CheckpointOperation write success. updated from 7054833084780249090[1642581328, 2] to 7054833935183773698[1642581526, 2]
[2022/01/19 16:35:45 CST] [INFO] [name=shard1, stage=incr, get=63009, filter=63009, write_success=0, tps=0, ckpt_times=5, lsn_ckpt={7054833930888806419[1642581525, 19], 2022-01-19 16:38:45}, lsn_ack={0[0, 0], 1970-01-01 08:00:00}]]
[2022/01/19 16:35:45 CST] [INFO] [name=shard2, stage=incr, get=124771, filter=124746, write_success=0, tps=0, ckpt_times=5, lsn_ckpt={7054833836399525984[1642581503, 96], 2022-01-19 16:38:23}, lsn_ack={0[0, 0], 1970-01-01 08:00:00}]]
[2022/01/19 16:35:45 CST] [INFO] [name=shard3, stage=incr, get=63665, filter=63665, write_success=0, tps=0, ckpt_times=5, lsn_ckpt={7054833935183773698[1642581526, 2], 2022-01-19 16:38:46}, lsn_ack={0[0, 0], 1970-01-01 08:00:00}]]
[2022/01/19 16:35:50 CST] [INFO] [name=shard1, stage=incr, get=63009, filter=63009, write_success=0, tps=0, ckpt_times=5, lsn_ckpt={7054833930888806419[1642581525, 19], 2022-01-19 16:38:45}, lsn_ack={0[0, 0], 1970-01-01 08:00:00}]]
[2022/01/19 16:35:50

配置的时候只写了一个库表,所以会有大量的过滤,想问一下这是什么原因造成的?

yushui16389
yushui16389

目前已经持续一个小时了,仍然没有把源库的新数据同步过来

Activity icon
issue

zhangst issue comment alibaba/MongoShake

zhangst
zhangst

全量同步完成后,增量同步没有新数据写入目的库

mongoshake版本:v2.6.5 mongodb版本:v4.2

源库不断写入新数据的情况下,开启一个mongoshake,用all模式把数据从源库同步至目的库 全量同步完成后进入增量同步,此时源库仍在不断写入新数据,但是目标库的数据不再增长。 查看日志,lsn_ckpt一直在更新为最新的时间,但是lsn_ack仍然停留在最初的时间。日志如下:

[2022/01/19 16:35:30 CST] [INFO] [name=shard2, stage=incr, get=124571, filter=124380, write_success=0, tps=0, ckpt_times=5, lsn_ckpt={7054833836399525984[1642581503, 96], 2022-01-19 16:38:23}, lsn_ack={0[0, 0], 1970-01-01 08:00:00}]]
[2022/01/19 16:35:30 CST] [INFO] [name=shard3, stage=incr, get=63664, filter=63664, write_success=0, tps=0, ckpt_times=4, lsn_ckpt={7054833084780249090[1642581328, 2], 2022-01-19 16:35:28}, lsn_ack={0[0, 0], 1970-01-01 08:00:00}]]
[2022/01/19 16:35:35 CST] [INFO] [name=shard1, stage=incr, get=63008, filter=63008, write_success=0, tps=0, ckpt_times=4, lsn_ckpt={7054833119139987469[1642581336, 13], 2022-01-19 16:35:36}, lsn_ack={0[0, 0], 1970-01-01 08:00:00}]]
[2022/01/19 16:35:35 CST] [INFO] [name=shard2, stage=incr, get=124595, filter=124571, write_success=0, tps=0, ckpt_times=5, lsn_ckpt={7054833836399525984[1642581503, 96], 2022-01-19 16:38:23}, lsn_ack={0[0, 0], 1970-01-01 08:00:00}]]
[2022/01/19 16:35:35 CST] [INFO] [name=shard3, stage=incr, get=63664, filter=63664, write_success=0, tps=0, ckpt_times=4, lsn_ckpt={7054833084780249090[1642581328, 2], 2022-01-19 16:35:28}, lsn_ack={0[0, 0], 1970-01-01 08:00:00}]]
[2022/01/19 16:35:40 CST] [INFO] Syncer[shard1] try to update checkpoint mandatory from 7054833119139987469[1642581336, 13] to 7054833930888806419[1642581525, 19]
[2022/01/19 16:35:40 CST] [INFO] Syncer[shard1] waiting last checkpoint[7054833930888806419[1642581525, 19]] updated
[2022/01/19 16:35:40 CST] [INFO] Syncer[shard1] last checkpoint[7054833930888806419[1642581525, 19]] updated [false]
[2022/01/19 16:35:40 CST] [INFO] shard1 Record new checkpoint success [1642581525]
[2022/01/19 16:35:40 CST] [INFO] CheckpointOperation write success. updated from 7054833119139987469[1642581336, 13] to 7054833930888806419[1642581525, 19]
[2022/01/19 16:35:40 CST] [INFO] [name=shard1, stage=incr, get=63009, filter=63009, write_success=0, tps=0, ckpt_times=5, lsn_ckpt={7054833930888806419[1642581525, 19], 2022-01-19 16:38:45}, lsn_ack={0[0, 0], 1970-01-01 08:00:00}]]
[2022/01/19 16:35:40 CST] [INFO] [name=shard2, stage=incr, get=124742, filter=124571, write_success=0, tps=0, ckpt_times=5, lsn_ckpt={7054833836399525984[1642581503, 96], 2022-01-19 16:38:23}, lsn_ack={0[0, 0], 1970-01-01 08:00:00}]]
[2022/01/19 16:35:40 CST] [INFO] [name=shard3, stage=incr, get=63665, filter=63664, write_success=0, tps=0, ckpt_times=4, lsn_ckpt={7054833084780249090[1642581328, 2], 2022-01-19 16:35:28}, lsn_ack={0[0, 0], 1970-01-01 08:00:00}]]
[2022/01/19 16:35:41 CST] [INFO] Syncer[shard3] try to update checkpoint mandatory from 7054833084780249090[1642581328, 2] to 7054833935183773698[1642581526, 2]
[2022/01/19 16:35:41 CST] [INFO] Syncer[shard3] waiting last checkpoint[7054833935183773698[1642581526, 2]] updated
[2022/01/19 16:35:41 CST] [INFO] Syncer[shard3] last checkpoint[7054833935183773698[1642581526, 2]] updated [false]
[2022/01/19 16:35:41 CST] [INFO] shard3 Record new checkpoint success [1642581526]
[2022/01/19 16:35:41 CST] [INFO] CheckpointOperation write success. updated from 7054833084780249090[1642581328, 2] to 7054833935183773698[1642581526, 2]
[2022/01/19 16:35:45 CST] [INFO] [name=shard1, stage=incr, get=63009, filter=63009, write_success=0, tps=0, ckpt_times=5, lsn_ckpt={7054833930888806419[1642581525, 19], 2022-01-19 16:38:45}, lsn_ack={0[0, 0], 1970-01-01 08:00:00}]]
[2022/01/19 16:35:45 CST] [INFO] [name=shard2, stage=incr, get=124771, filter=124746, write_success=0, tps=0, ckpt_times=5, lsn_ckpt={7054833836399525984[1642581503, 96], 2022-01-19 16:38:23}, lsn_ack={0[0, 0], 1970-01-01 08:00:00}]]
[2022/01/19 16:35:45 CST] [INFO] [name=shard3, stage=incr, get=63665, filter=63665, write_success=0, tps=0, ckpt_times=5, lsn_ckpt={7054833935183773698[1642581526, 2], 2022-01-19 16:38:46}, lsn_ack={0[0, 0], 1970-01-01 08:00:00}]]
[2022/01/19 16:35:50 CST] [INFO] [name=shard1, stage=incr, get=63009, filter=63009, write_success=0, tps=0, ckpt_times=5, lsn_ckpt={7054833930888806419[1642581525, 19], 2022-01-19 16:38:45}, lsn_ack={0[0, 0], 1970-01-01 08:00:00}]]
[2022/01/19 16:35:50

配置的时候只写了一个库表,所以会有大量的过滤,想问一下这是什么原因造成的?

zhangst
zhangst

增量同步持续多长时间了呢?

push

HuangXingBo push alibaba/pemja

HuangXingBo
HuangXingBo

Changes java privitive array mappings to Python List

commit sha: f9d5c7b0dfb5ffe222ad2d8c4b3e4abc4f340168

push time in 3 minutes ago
Activity icon
fork

zhangzc90 forked alibaba/flutter_boost

⚡ FlutterBoost is a Flutter plugin which enables hybrid integration of Flutter for your existing native apps with minimum efforts
zhangzc90 MIT License Updated
fork time in 3 minutes ago
Activity icon
issue

ja-peng issue alibaba/Sentinel

ja-peng
ja-peng

Circuit breaker for API gateway | 熔断不生效

Issue Description

Type: bug report 依据wiki中api网关demo代码,编写了配置类,在spring启动的时候,自定义api分组加载到sentinel中,给api分组分配的流控规则可以生效,但是降级规则不能生效,在dashboard界面上的“请求链路”上加降级规则也不生效 image image image jemeter测试结果: image

Describe what you expected to happen

代码中加载的熔断降级规则生效

How to reproduce it (as minimally and precisely as possible)

Tell us your environment

    <dependency>
        <groupId>com.alibaba.cloud</groupId>
        <artifactId>spring-cloud-starter-alibaba-sentinel</artifactId>
        <version>2.2.7.RELEASE</version>
    </dependency>
    <dependency>
        <groupId>com.alibaba.csp</groupId>
        <artifactId>sentinel-transport-simple-http</artifactId>
        <version>1.8.1</version>
    </dependency>
    <dependency>
        <groupId>com.alibaba.csp</groupId>
        <artifactId>sentinel-spring-cloud-gateway-adapter</artifactId>
        <version>1.8.1</version>
    </dependency>
    <dependency>
        <groupId>com.alibaba.csp</groupId>
        <artifactId>sentinel-parameter-flow-control</artifactId>
        <version>1.8.1</version>
    </dependency>
    <dependency>
        <groupId>org.springframework.cloud</groupId>
        <artifactId>spring-cloud-starter-gateway</artifactId>
    </dependency>

Anything else we need to know?

started
started time in 6 minutes ago
pull request

mars1024 merge to alibaba/hybridnet

mars1024
mars1024

Daemon controller-runtime adapt

Pull Request Description

Describe what this PR does / why we need it

Does this pull request fix one issue?

Describe how you did it

Describe how to verify it

Special notes for reviews

pull request

mars1024 merge to alibaba/hybridnet

mars1024
mars1024

Daemon controller-runtime adapt

Pull Request Description

Describe what this PR does / why we need it

Does this pull request fix one issue?

Describe how you did it

Describe how to verify it

Special notes for reviews

open pull request

mars1024 wants to merge alibaba/hybridnet

mars1024
mars1024

Daemon controller-runtime adapt

Pull Request Description

Describe what this PR does / why we need it

Does this pull request fix one issue?

Describe how you did it

Describe how to verify it

Special notes for reviews

mars1024
mars1024

why use APIReader not client here>

started
started time in 9 minutes ago
pull request

SuperDubbo pull request alibaba/fastjson

SuperDubbo
SuperDubbo

1、Fixed fastjson handle LocalTime and Add global config for LocalTime

1、修复LocalTime序列化,格式飘忽不定问题,比如LocalTime(20:30:01)可以正常序列化为20:30:01,但比如LocalTime(20:30:00)却序列化为20:30,没有秒单位。由于原来使用的是LocalTime的toString()方法导致;Fixed #1858 2、支持全局配置LocalTime序列化格式;

Activity icon
fork

QianhuaGuo forked alibaba/easyexcel

⚡ 快速、简洁、解决大文件内存溢出的java处理Excel工具
QianhuaGuo Apache License 2.0 Updated
fork time in 11 minutes ago
Activity icon
issue

warlock-deng issue alibaba/druid

warlock-deng
warlock-deng

Index 1 out of bounds for length 1

异常内容如下图所示: image

异常处代码如下所示: private Filter nextFilter() { return getFilters() .get(pos++); } 该问题非必现,求解

pull request

SuperDubbo pull request alibaba/fastjson

SuperDubbo
SuperDubbo

fastjson LocalTime序列化格式不定,LocalTime全局配置支持

1、修复LocalTime序列化,格式飘忽不定问题,比如LocalTime(20:30:01)可以正常序列化为20:30:01,但比如LocalTime(20:30:00)却序列化为20:30,没有秒单位。由于原来使用的是LocalTime的toString()方法导致;Fixed #1858 2、支持全局配置LocalTime序列化格式;

push

bmmcq push alibaba/GraphScope

bmmcq
bmmcq

[GAIA/engine] update echo server example & tidy up;

commit sha: 1b20693bc7442e694134a4d30f05001d7539c91c

push time in 12 minutes ago
Activity icon
fork

RobertLou forked alibaba/DeepRec

⚡ DeepRec is a recommendation engine based on TensorFlow.
RobertLou Apache License 2.0 Updated
fork time in 13 minutes ago
Activity icon
issue

wethura issue alibaba/nacos

wethura
wethura

the config in console would be deleted after rollback, but expected not.

Desc

the config in console would be deleted after rollback, but expected not.

Version

2.0.3

Operate

  1. create a new config. (version no.1)
  2. edit the config which was created. (version no.2)
  3. rollback the upper config to version no.1.

Result

i can not find the config in menu[configManagenment/Configurations]

Expected

the config (version 1) can be find in menu[configManagenment/Configurations]

started
started time in 18 minutes ago
Activity icon
issue

wjkaola123 issue alibaba/nacos

wjkaola123
wjkaola123

Nacos 2.0.3版本通过API接口注册永久实例失败

Describe the bug Nacos 2.0.3版本通过API接口注册永久实例失败, 接口返回OK,但是页面上没有显示注册成功,看不到服务上线。 但是可以注册临时实例, 临时注册的实例会上线。

Expected behavior 通过API接口可以注册永久实例,并成功上线。

Acutally behavior

How to Reproduce Steps to reproduce the behavior: 【永久实例情况】:

  1. 接口调用成功 image
  2. 服务没有在线 image

【临时实例情况】:

  1. 接口调用成功

image

  1. 服务会显示在线

image

Desktop (please complete the following information):

  • OS: [e.g. Centos]
  • Version [e.g. nacos-server 2.0.3]
  • Module [调用API接口注册nacos实例]

Additional context Add any other context about the problem here.

started
started time in 19 minutes ago
started
started time in 20 minutes ago
open pull request

Stevent-fei wants to merge alibaba/sealer

Stevent-fei
Stevent-fei

[WIP]Add auto-build action

Describe what this PR does / why we need it

Does this pull request fix one issue?

Describe how you did it

Describe how to verify it

Special notes for reviews

Stevent-fei
Stevent-fei

The premise of using kubedm is to install kubedm. I think setting it to variable will make all versions render, and I have tested it

pull request

Stevent-fei merge to alibaba/sealer

Stevent-fei
Stevent-fei

[WIP]Add auto-build action

Describe what this PR does / why we need it

Does this pull request fix one issue?

Describe how you did it

Describe how to verify it

Special notes for reviews

started
started time in 23 minutes ago
Activity icon
issue

chj-damon issue alibaba/hooks

chj-damon
chj-damon

希望useWebsocket可以透传websocket实例给options里的事件

目前websocket里面options定义的事件的参数只是原生的参数,没有websocket实例,这时候如果想要实现类似在建立连接之后立刻往服务端发送消息的需求时,做法就比较绕:

const { readyState, sendMessage, latestMessage } = useWebSocket(
    'ws://localhost:8080/ws',
    {
      onOpen() {
        console.log('和服务端已建立连接');
      },
      onMessage(msg) {
        console.log('收到服务端推送数据: ', msg);
      },
      onClose() {
        console.log('和服务端断开连接');
      },
      onError(e) {
        console.error(e);
      },
    },
  );

  /** 建立连接后立刻发送Token到服务端进行身份认证 */
  useEffect(() => {
    if (readyState === ReadyState.Open) {
      sendMessage?.(JSON.stringify({ Token: 30001, Event: 'dataChange' }));
    }
  }, [readyState, sendMessage]);

如果可以直接把websocket实例透传给这些事件,那么实现起来就会更加清爽:

const { readyState, sendMessage, latestMessage } = useWebSocket(
    'ws://192.168.1.198:12345/ws',
    {
      onOpen(e, ws) {
        console.log('和服务端已建立连接');
        /** 建立连接后立刻和服务端通信 */
       ws.send("hello websocket server");
      },
      onMessage(msg) {
        console.log('收到服务端推送数据: ', msg);
      },
      onClose() {
        console.log('和服务端断开连接');
      },
      onError(e) {
        console.error(e);
      },
    },
  );

started
started time in 25 minutes ago
push

sighingnow push alibaba/GraphScope

sighingnow
sighingnow

Raise an error and tell users what to do on Windows. (#1285)

Signed-off-by: Tao He [email protected]

commit sha: b683dcd7969154622772d1f7d7c1a21685580c10

push time in 25 minutes ago
pull request

sighingnow pull request alibaba/GraphScope

sighingnow
sighingnow

Raise an error and tell users what to do on Windows.

What do these changes do?

Raise an meaningful error message when users are trying to install graphscope on Windows.

Related issue number

Fixes #1284.

Previous