Sep 18 11:17:25 devstack cinder-volume[75380]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75380) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 18 11:17:25 devstack cinder-volume[75380]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75380) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 18 11:17:25 devstack cinder-volume[75380]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75380) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 18 11:17:27 devstack cinder-volume[75380]: INFO dbcounter [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] Registered counter for database cinder
Sep 18 11:17:27 devstack cinder-volume[75380]: DEBUG oslo_db.sqlalchemy.engines [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75380) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 18 11:17:27 devstack cinder-volume[75380]: DEBUG dbcounter [-] [75380] Writer thread running {{(pid=75380) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 18 11:17:27 devstack cinder-volume[75380]: INFO cinder.rpc [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 18 11:17:27 devstack cinder-volume[75380]: INFO cinder.rpc [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 18 11:17:27 devstack cinder-volume[75380]: DEBUG oslo_db.sqlalchemy.engines [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75380) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 18 11:17:27 devstack cinder-volume[75380]: INFO cinder.volume.manager [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] Determined volume DB was empty at startup.
Sep 18 11:17:27 devstack cinder-volume[75380]: DEBUG cinder.volume.manager [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75380) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 18 11:17:27 devstack cinder-volume[75380]: INFO cinder.volume.manager [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 18 11:17:27 devstack cinder-volume[75380]: WARNING stevedore.named [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 18 11:17:27 devstack cinder-volume[75380]: WARNING castellan.key_manager [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 18 11:17:27 devstack cinder-volume[75380]: WARNING cinder.keymgr.conf_key_mgr [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 18 11:17:28 devstack cinder-volume[75380]: DEBUG cinder.volume.drivers.lvm [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75380) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Sep 18 11:17:28 devstack cinder-volume[75380]: DEBUG oslo_concurrency.processutils [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_concurrency.processutils [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] CMD "cinder-rtstool verify" returned: 0 in 0.991s {{(pid=75380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_db.sqlalchemy.engines [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75380) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 18 11:17:29 devstack cinder-volume[75380]: INFO cinder.rpc [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 18 11:17:29 devstack cinder-volume[75380]: INFO cinder.rpc [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 18 11:17:29 devstack cinder-volume[75380]: WARNING stevedore.named [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 18 11:17:29 devstack cinder-volume[75380]: WARNING castellan.key_manager [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 18 11:17:29 devstack cinder-volume[75380]: INFO cinder.volume.manager [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_db.sqlalchemy.engines [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75380) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 18 11:17:29 devstack cinder-volume[75380]: INFO oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] Starting 1 workers
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] Started child 75478 {{(pid=75380) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] Full set of CONF: {{(pid=75380) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] ******************************************************************************** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] Configuration options gathered from: {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] ================================================================================ {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] allow_availability_zone_fallback = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] allow_compression_on_image_upload = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] allowed_direct_url_schemes     = [] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] api_rate_limit                 = True {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] auth_strategy                  = keystone {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] az_cache_duration              = 3600 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_availability_zone      = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_host                   = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_name                   = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_stats_polling_interval = 60 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backup_api_class               = cinder.backup.api.API {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backup_name_template           = backup-%s {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backup_use_same_host           = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backup_use_temp_snapshot       = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] chap_password                  = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] chap_username                  =  {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cinder_internal_tenant_project_id = 71b16d157cf64fc98fdffbc74bc7dcda {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cinder_internal_tenant_user_id = 2abc72dd6d844c58af5130ff976e08c3 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cloned_volume_same_az          = True {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cluster                        = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] compression_format             = gzip {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] compute_api_class              = cinder.compute.nova.API {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] config_dir                     = [] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] config_source                  = [] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] control_exchange               = openstack {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] debug                          = True {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] default_availability_zone      = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] default_group_type             = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] default_volume_type            = lvmdriver-1 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] driver_client_cert             = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] driver_client_cert_key         = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] driver_data_namespace          = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] driver_ssl_cert_path           = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] driver_ssl_cert_verify         = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] driver_use_ssl                 = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] enable_force_upload            = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] enable_new_services            = True {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] enable_unsupported_driver      = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] enforce_multipath_for_image_xfer = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] filter_function                = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] glance_api_insecure            = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] glance_api_servers             = ['http://192.168.122.182/image'] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] glance_api_ssl_compression     = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] glance_ca_certificates_file    = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] glance_catalog_info            = image:glance:publicURL {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] glance_certfile                = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] glance_keyfile                 = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] glance_num_retries             = 3 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] glance_request_timeout         = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] goodness_function              = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] graceful_shutdown_timeout      = 5 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] group_api_class                = cinder.group.api.API {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] host                           = devstack {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] image_compress_on_upload       = True {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] image_conversion_address_space_limit = 1 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] image_conversion_cpu_limit     = 60 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] image_conversion_disable       = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] image_upload_use_cinder_backend = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] image_upload_use_internal_tenant = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] image_volume_cache_enabled     = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] image_volume_cache_max_count   = 0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] image_volume_cache_max_size_gb = 0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] init_host_max_objects_retrieval = 0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] instance_format                = [instance: %(uuid)s]  {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] iscsi_iotype                   = fileio {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] iscsi_target_flags             =  {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] iscsi_write_cache              = on {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] iser_helper                    = tgtadm {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] iser_ip_address                = 192.168.122.182 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] iser_port                      = 3260 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] log_color                      = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] log_config_append              = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] log_dir                        = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] log_file                       = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] log_options                    = True {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] log_rotate_interval            = 1 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] log_rotate_interval_type       = days {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] log_rotation_type              = none {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] max_age                        = 0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] max_logfile_count              = 30 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] max_logfile_size_mb            = 200 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] max_over_subscription_ratio    = 20.0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] message_reap_interval          = 86400 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] message_ttl                    = 2592000 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] migration_create_volume_timeout_secs = 300 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] monkey_patch                   = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] monkey_patch_modules           = [] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] my_ip                          = 192.168.122.182 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] no_snapshot_gb_quota           = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] num_iser_scan_tries            = 3 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] num_shell_tries                = 3 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] num_volume_device_scan_tries   = 3 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] nvmeof_conn_info_version       = 1 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] nvmet_ns_id                    = 10 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] nvmet_port_id                  = 1 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] osapi_max_limit                = 1000 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] osapi_volume_ext_list          = [] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] osapi_volume_listen_port       = 8776 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] osapi_volume_use_ssl           = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] osapi_volume_workers           = 2 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] per_volume_size_limit          = -1 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] periodic_fuzzy_delay           = 60 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] periodic_interval              = 60 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] public_endpoint                = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] publish_errors                 = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] quota_backup_gigabytes         = 1000 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] quota_backups                  = 10 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] quota_gigabytes                = 1000 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] quota_groups                   = 10 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] quota_snapshots                = 10 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] quota_volumes                  = 10 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] rate_limit_burst               = 0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] rate_limit_except_level        = CRITICAL {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] rate_limit_interval            = 0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] reinit_driver_count            = 3 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] replication_device             = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] report_discard_supported       = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] report_interval                = 120 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] reservation_clean_interval     = 86400 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] reservation_expire             = 86400 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] reserved_image_namespaces      = [] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] reserved_percentage            = 0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] rpc_response_timeout           = 120 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] run_external_periodic_tasks    = True {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] scst_target_driver             = iscsi {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] scst_target_iqn_name           = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] service_down_time              = 720 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] shell_completion               = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] snapshot_name_template         = snapshot-%s {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] snapshot_same_host             = True {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] split_loggers                  = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] state_path                     = /opt/stack/data/cinder {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] storage_availability_zone      = nova {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] storage_protocol               = iSCSI {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] syslog_log_facility            = LOG_USER {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] target_helper                  = lioadm {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] target_ip_address              = 192.168.122.182 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] target_port                    = 3260 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] target_protocol                = iscsi {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] target_secondary_ip_addresses  = [] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] trace_flags                    = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] transport_url                  = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] until_refresh                  = 0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] use_chap_auth                  = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] use_default_quota_class        = True {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] use_journal                    = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:29 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] use_json                       = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] use_multipath_for_image_xfer   = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] use_stderr                     = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] use_syslog                     = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] verify_glance_signatures       = enabled {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] volume_api_class               = cinder.volume.api.API {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] volume_backend_name            = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] volume_clear                   = zero {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] volume_clear_ionice            = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] volume_clear_size              = 0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] volume_copy_bps_limit          = 0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] volume_dd_blocksize            = 1M {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] volume_name_template           = volume-%s {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] volume_service_inithost_offload = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] volume_usage_audit_period      = month {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] watch_log_file                 = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] zoning_mode                    = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_concurrency.disable_process_locking = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.admin_password = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.admin_token = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.admin_user  = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.auth_admin_prefix =  {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.auth_port   = 35357 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.auth_protocol = https {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.auth_section = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.auth_type   = password {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.auth_uri    = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.auth_version = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.cache       = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.certfile    = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.delay_auth_decision = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.http_connect_timeout = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.identity_uri = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.include_service_catalog = True {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.insecure    = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.interface   = public {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.keyfile     = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.memcache_password =  {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.memcache_username =  {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.region_name = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.service_token_roles_required = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.service_type = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.token_cache_time = 300 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] keystone_authtoken.www_authenticate_uri = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cache.backend                  = dogpile.cache.null {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cache.backend_argument         = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cache.backend_expiration_time  = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cache.config_prefix            = cache.oslo {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cache.dead_timeout             = 60.0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cache.debug_cache_backend      = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cache.enable_retry_client      = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cache.enable_socket_keepalive  = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cache.enabled                  = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cache.enforce_fips_mode        = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cache.expiration_time          = 600 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cache.hashclient_retry_attempts = 2 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cache.memcache_dead_retry      = 300 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cache.memcache_password        = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cache.memcache_pool_maxsize    = 10 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cache.memcache_sasl_enabled    = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cache.memcache_username        = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cache.proxies                  = [] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cache.redis_db                 = 0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cache.redis_password           = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cache.redis_sentinel_service_name = mymaster {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cache.redis_server             = localhost:6379 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cache.redis_socket_timeout     = 1.0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cache.redis_username           = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cache.retry_attempts           = 2 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cache.retry_delay              = 0.0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cache.socket_keepalive_count   = 1 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cache.socket_keepalive_idle    = 1 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cache.socket_keepalive_interval = 1 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cache.tls_allowed_ciphers      = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cache.tls_cafile               = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cache.tls_certfile             = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cache.tls_enabled              = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cache.tls_keyfile              = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] coordination.backend_url       = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] database.asyncio_connection    = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] database.asyncio_slave_connection = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] database.backend               = sqlalchemy {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] database.connection            = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] database.connection_debug      = 0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] database.connection_parameters =  {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] database.connection_recycle_time = 3600 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] database.connection_trace      = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] database.db_inc_retry_interval = True {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] database.db_max_retries        = 20 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] database.db_max_retry_interval = 10 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] database.db_retry_interval     = 1 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] database.max_overflow          = 50 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] database.max_pool_size         = 5 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] database.max_retries           = 10 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] database.mysql_wsrep_sync_wait = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] database.pool_timeout          = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] database.retry_interval        = 10 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] database.slave_connection      = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] database.sqlite_synchronous    = True {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] database.use_db_reconnect      = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] profiler.connection_string     = messaging:// {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] profiler.enabled               = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] profiler.es_doc_type           = notification {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] profiler.es_scroll_size        = 10000 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] profiler.es_scroll_time        = 2m {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] profiler.filter_error_trace    = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] profiler.hmac_keys             = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] profiler.sentinel_service_name = mymaster {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] profiler.socket_timeout        = 0.1 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] profiler.trace_requests        = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] profiler.trace_sqlalchemy      = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] profiler_jaeger.process_tags   = {} {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] profiler_jaeger.service_name_prefix = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] profiler_otlp.service_name_prefix = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_policy.enforce_new_defaults = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: WARNING oslo_config.cfg [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_policy.enforce_scope      = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_policy.policy_default_rule = default {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_policy.policy_file        = policy.yaml {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] privsep_osbrick.group          = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] privsep_osbrick.helper_command = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] privsep_osbrick.thread_pool_size = 3 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] privsep_osbrick.user           = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cinder_sys_admin.group         = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cinder_sys_admin.helper_command = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] cinder_sys_admin.user          = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] service_user.auth_section      = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] service_user.auth_type         = password {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] service_user.certfile          = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] service_user.collect_timing    = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] service_user.insecure          = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] service_user.keyfile           = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] service_user.send_service_user_token = True {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] service_user.split_loggers     = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] service_user.timeout           = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] glance.auth_section            = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] glance.auth_type               = password {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75478]: INFO cinder.service [-] Starting cinder-volume node (version 27.0.0)
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] glance.certfile                = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] glance.collect_timing          = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] glance.insecure                = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] glance.keyfile                 = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] glance.split_loggers           = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] glance.timeout                 = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.backend_availability_zone = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.chap_password = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.chap_username =  {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.driver_client_cert = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.driver_client_cert_key = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.driver_data_namespace = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.driver_use_ssl = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.enable_unsupported_driver = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.extra_capabilities = {} {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.filter_function = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.goodness_function = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.iscsi_iotype  = fileio {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.iscsi_target_flags =  {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.iscsi_write_cache = on {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.iser_helper   = tgtadm {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.iser_ip_address = 192.168.122.182 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.iser_port     = 3260 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.lvm_share_target = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.lvm_type      = auto {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.num_shell_tries = 3 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.nvmet_port_id = 1 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.replication_device = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.report_discard_supported = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.reserved_percentage = 0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.scst_target_driver = iscsi {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.scst_target_iqn_name = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.storage_protocol = iSCSI {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.target_helper = tgtadm {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.target_ip_address = 192.168.122.182 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.target_port   = 3260 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.target_protocol = iscsi {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.trace_flags   = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.unique_fqdn_network = True {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.use_chap_auth = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.volume_backend_name = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.volume_clear  = zero {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.volume_clear_ionice = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.volume_clear_size = 0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_reports.file_event_handler = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_reports.log_dir           = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.backend_availability_zone = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.backend_host       = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.chap_password      = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.chap_username      = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.driver_client_cert = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.driver_data_namespace = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.extra_capabilities = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.filter_function    = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.goodness_function  = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.iscsi_iotype       = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.iser_helper        = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.iser_ip_address    = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.iser_port          = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.iser_target_prefix = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.lvm_share_target   = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.lvm_type           = auto {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.num_shell_tries    = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.replication_device = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.report_discard_supported = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.reserved_percentage = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.scst_target_driver = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.storage_protocol   = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.target_helper      = lioadm {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.target_ip_address  = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.target_port        = 3260 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.trace_flags        = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.use_chap_auth      = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.volume_clear       = zero {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.volume_clear_size  = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] lvmdriver-1.volumes_dir        = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_rabbit.ssl      = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_notifications.driver = [] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_notifications.retry = -1 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] oslo_messaging_notifications.transport_url = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] key_manager.fixed_key          = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] barbican.barbican_api_version  = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] barbican.barbican_endpoint     = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] barbican.barbican_endpoint_type = public {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] barbican.barbican_region_name  = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] barbican.cafile                = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] barbican.certfile              = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] barbican.collect_timing        = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] barbican.insecure              = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] barbican.keyfile               = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] barbican.number_of_retries     = 60 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] barbican.retry_delay           = 1 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] barbican.send_service_user_token = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] barbican.split_loggers         = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] barbican.timeout               = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] barbican.verify_ssl            = True {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] barbican.verify_ssl_path       = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] barbican_service_user.auth_section = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] barbican_service_user.auth_type = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] barbican_service_user.cafile   = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] barbican_service_user.certfile = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] barbican_service_user.collect_timing = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] barbican_service_user.insecure = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] barbican_service_user.keyfile  = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] barbican_service_user.split_loggers = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] barbican_service_user.timeout  = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] vault.approle_role_id          = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] vault.approle_secret_id        = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] vault.kv_mountpoint            = secret {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] vault.kv_path                  = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] vault.kv_version               = 2 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] vault.namespace                = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] vault.root_token_id            = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] vault.ssl_ca_crt_file          = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] vault.timeout                  = 60.0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] vault.use_ssl                  = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:17:30 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] ******************************************************************************** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 18 11:17:30 devstack cinder-volume[75478]: INFO cinder.volume.manager [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 18 11:17:30 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:17:30 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.160s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:17:30 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:17:30 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.111s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:17:30 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:17:30 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.142s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:17:30 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:17:31 devstack sudo[75506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 18 11:17:31 devstack sudo[75506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:17:33 devstack sudo[75506]: pam_unix(sudo:session): session closed for user root
Sep 18 11:17:33 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 2.125s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:17:33 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:17:33 devstack sudo[75644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 11:17:33 devstack sudo[75644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:17:35 devstack sudo[75644]: pam_unix(sudo:session): session closed for user root
Sep 18 11:17:35 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 2.010s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:17:35 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 11:17:35 devstack cinder-volume[75478]: INFO cinder.brick.local_dev.lvm [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 18 11:17:35 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:17:35 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.085s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:17:35 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:17:35 devstack sudo[75751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 11:17:35 devstack sudo[75751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:17:37 devstack sudo[75751]: pam_unix(sudo:session): session closed for user root
Sep 18 11:17:37 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.042s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:17:37 devstack cinder-volume[75478]: DEBUG cinder.brick.local_dev.lvm [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75478) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Sep 18 11:17:37 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:17:37 devstack sudo[75844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 11:17:37 devstack sudo[75844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:17:39 devstack cinder-volume[75380]: DEBUG dbcounter [-] [75380] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75380) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:17:40 devstack sudo[75844]: pam_unix(sudo:session): session closed for user root
Sep 18 11:17:40 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 3.477s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:17:40 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:17:40 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.080s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:17:40 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:17:40 devstack sudo[76042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 11:17:40 devstack sudo[76042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:17:43 devstack sudo[76042]: pam_unix(sudo:session): session closed for user root
Sep 18 11:17:43 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.250s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:17:43 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:17:43 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.118s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:17:43 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:17:43 devstack sudo[76116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 18 11:17:43 devstack sudo[76116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:17:45 devstack sudo[76116]: pam_unix(sudo:session): session closed for user root
Sep 18 11:17:45 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 2.101s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:17:45 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:17:45 devstack sudo[76154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 11:17:45 devstack sudo[76154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:17:48 devstack sudo[76154]: pam_unix(sudo:session): session closed for user root
Sep 18 11:17:48 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.880s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:17:48 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:17:48 devstack sudo[76242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 11:17:48 devstack sudo[76242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:17:50 devstack sudo[76242]: pam_unix(sudo:session): session closed for user root
Sep 18 11:17:50 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.363s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:17:50 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:17:50 devstack sudo[76247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 11:17:50 devstack sudo[76247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:17:53 devstack sudo[76247]: pam_unix(sudo:session): session closed for user root
Sep 18 11:17:53 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 3.142s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:17:53 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:17:54 devstack sudo[76257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 11:17:54 devstack sudo[76257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:17:56 devstack sudo[76257]: pam_unix(sudo:session): session closed for user root
Sep 18 11:17:56 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.365s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:17:56 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:17:56 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.111s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:17:56 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:17:56 devstack sudo[76263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 11:17:56 devstack sudo[76263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:17:58 devstack sudo[76263]: pam_unix(sudo:session): session closed for user root
Sep 18 11:17:58 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.150s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:17:58 devstack cinder-volume[75478]: INFO cinder.volume.drivers.lvm [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 18 11:17:58 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:17:58 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.088s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:17:58 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:17:58 devstack sudo[76321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 11:17:58 devstack sudo[76321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:18:00 devstack sudo[76321]: pam_unix(sudo:session): session closed for user root
Sep 18 11:18:00 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.192s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:18:00 devstack cinder-volume[75478]: DEBUG cinder.volume.drivers.lvm [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Updating volume stats {{(pid=75478) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 18 11:18:00 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:18:01 devstack sudo[76387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 11:18:01 devstack sudo[76387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:18:02 devstack sudo[76387]: pam_unix(sudo:session): session closed for user root
Sep 18 11:18:02 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.904s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:18:02 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:18:03 devstack sudo[76526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 11:18:03 devstack sudo[76526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:18:05 devstack sudo[76526]: pam_unix(sudo:session): session closed for user root
Sep 18 11:18:05 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.250s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:18:05 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:18:05 devstack sudo[76529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 11:18:05 devstack sudo[76529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:18:08 devstack sudo[76529]: pam_unix(sudo:session): session closed for user root
Sep 18 11:18:08 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.884s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:18:08 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:18:08 devstack sudo[76534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 11:18:08 devstack sudo[76534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:18:09 devstack sudo[76534]: pam_unix(sudo:session): session closed for user root
Sep 18 11:18:09 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.796s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:18:09 devstack cinder-volume[75478]: INFO cinder.volume.driver [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Driver hasn't implemented _init_vendor_properties()
Sep 18 11:18:09 devstack cinder-volume[75478]: DEBUG cinder.volume.driver [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75478) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}}
Sep 18 11:18:10 devstack cinder-volume[75478]: DEBUG oslo_db.sqlalchemy.engines [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75478) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 18 11:18:10 devstack cinder-volume[75478]: DEBUG dbcounter [-] [75478] Writer thread running {{(pid=75478) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 18 11:18:10 devstack cinder-volume[75478]: DEBUG cinder.db.sqlalchemy.api [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Building query based on filter {{(pid=75478) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 18 11:18:10 devstack cinder-volume[75478]: DEBUG cinder.image.image_utils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75478) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 18 11:18:10 devstack cinder-volume[75478]: INFO cinder.keymgr.migration [None req-2c30d3e3-45e3-4c98-908d-3e7b8977503e None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 18 11:18:10 devstack cinder-volume[75478]: DEBUG cinder.volume.drivers.lvm [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Updating volume stats {{(pid=75478) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 18 11:18:10 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:18:10 devstack sudo[76541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 11:18:10 devstack sudo[76541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:18:12 devstack sudo[76541]: pam_unix(sudo:session): session closed for user root
Sep 18 11:18:12 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.871s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:18:12 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:18:12 devstack sudo[76544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 11:18:12 devstack sudo[76544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:18:14 devstack sudo[76544]: pam_unix(sudo:session): session closed for user root
Sep 18 11:18:14 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.362s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:18:14 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:18:14 devstack sudo[76661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 11:18:14 devstack sudo[76661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:18:16 devstack sudo[76661]: pam_unix(sudo:session): session closed for user root
Sep 18 11:18:16 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.215s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:18:16 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:18:17 devstack sudo[76691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 11:18:17 devstack sudo[76691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:18:18 devstack sudo[76691]: pam_unix(sudo:session): session closed for user root
Sep 18 11:18:18 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.960s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:18:18 devstack cinder-volume[75478]: DEBUG cinder.manager [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Notifying Schedulers of capabilities ... {{(pid=75478) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:18:19 devstack cinder-volume[75478]: INFO cinder.volume.manager [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Driver initialization completed successfully.
Sep 18 11:18:19 devstack cinder-volume[75478]: INFO cinder.manager [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Initiating service 2 cleanup
Sep 18 11:18:19 devstack cinder-volume[75478]: INFO cinder.manager [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Service 2 cleanup completed.
Sep 18 11:18:19 devstack cinder-volume[75478]: DEBUG cinder.service [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Creating RPC server for service cinder-volume {{(pid=75478) start /opt/stack/cinder/cinder/service.py:239}}
Sep 18 11:18:19 devstack cinder-volume[75478]: DEBUG cinder.service [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75478) start /opt/stack/cinder/cinder/service.py:245}}
Sep 18 11:18:19 devstack cinder-volume[75478]: INFO cinder.volume.manager [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 18 11:18:19 devstack cinder-volume[75478]: DEBUG cinder.volume.drivers.lvm [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Updating volume stats {{(pid=75478) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 18 11:18:19 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:18:19 devstack sudo[76694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 11:18:19 devstack sudo[76694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:18:20 devstack cinder-volume[75478]: DEBUG dbcounter [-] [75478] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75478) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:18:21 devstack sudo[76694]: pam_unix(sudo:session): session closed for user root
Sep 18 11:18:21 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.994s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:18:21 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:18:21 devstack sudo[76704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 11:18:21 devstack sudo[76704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:18:23 devstack sudo[76704]: pam_unix(sudo:session): session closed for user root
Sep 18 11:18:23 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.000s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:18:23 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:18:23 devstack sudo[76707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 11:18:23 devstack sudo[76707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:18:25 devstack sudo[76707]: pam_unix(sudo:session): session closed for user root
Sep 18 11:18:25 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.966s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:18:25 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:18:25 devstack sudo[76714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 11:18:25 devstack sudo[76714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:18:27 devstack sudo[76714]: pam_unix(sudo:session): session closed for user root
Sep 18 11:18:27 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.199s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:18:27 devstack cinder-volume[75478]: INFO cinder.volume.manager [None req-afa83d8e-ee0b-44c7-aba9-e620f1361c76 None None] Driver post RPC initialization completed successfully.
Sep 18 11:18:29 devstack cinder-volume[75478]: DEBUG dbcounter [-] [75478] Writing DB stats cinder:SELECT=4 {{(pid=75478) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:18:37 devstack cinder-volume[75478]: DEBUG dbcounter [-] [75478] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75478) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:18:53 devstack cinder-volume[75478]: DEBUG oslo_service.periodic_task [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 11:18:53 devstack cinder-volume[75478]: DEBUG cinder.volume.drivers.lvm [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Updating volume stats {{(pid=75478) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 18 11:18:53 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:18:54 devstack sudo[77526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 11:18:54 devstack sudo[77526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:18:55 devstack sudo[77526]: pam_unix(sudo:session): session closed for user root
Sep 18 11:18:55 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.945s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:18:55 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:18:55 devstack sudo[77591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 11:18:55 devstack sudo[77591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:18:57 devstack sudo[77591]: pam_unix(sudo:session): session closed for user root
Sep 18 11:18:57 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.908s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:18:57 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:18:57 devstack sudo[77649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 11:18:57 devstack sudo[77649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:18:59 devstack sudo[77649]: pam_unix(sudo:session): session closed for user root
Sep 18 11:18:59 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.009s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:18:59 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:18:59 devstack sudo[77689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 11:18:59 devstack sudo[77689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:19:01 devstack sudo[77689]: pam_unix(sudo:session): session closed for user root
Sep 18 11:19:01 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.116s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:19:02 devstack cinder-volume[75478]: DEBUG cinder.manager [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Notifying Schedulers of capabilities ... {{(pid=75478) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:19:53 devstack cinder-volume[75478]: DEBUG oslo_service.periodic_task [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 11:19:53 devstack cinder-volume[75478]: DEBUG cinder.volume.drivers.lvm [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Updating volume stats {{(pid=75478) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 18 11:19:53 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:19:54 devstack sudo[78180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 11:19:54 devstack sudo[78180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:19:55 devstack sudo[78180]: pam_unix(sudo:session): session closed for user root
Sep 18 11:19:55 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.915s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:19:55 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:19:55 devstack sudo[78259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 11:19:55 devstack sudo[78259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:19:57 devstack sudo[78259]: pam_unix(sudo:session): session closed for user root
Sep 18 11:19:57 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.963s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:19:57 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:19:57 devstack sudo[78326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 11:19:57 devstack sudo[78326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:19:59 devstack sudo[78326]: pam_unix(sudo:session): session closed for user root
Sep 18 11:19:59 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.988s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:19:59 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:19:59 devstack sudo[78329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 11:19:59 devstack sudo[78329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:20:01 devstack sudo[78329]: pam_unix(sudo:session): session closed for user root
Sep 18 11:20:01 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.889s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:20:01 devstack cinder-volume[75478]: DEBUG cinder.manager [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Notifying Schedulers of capabilities ... {{(pid=75478) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:20:38 devstack cinder-volume[75478]: DEBUG dbcounter [-] [75478] Writing DB stats cinder:SELECT=1 {{(pid=75478) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:20:38 devstack cinder-volume[75478]: DEBUG dbcounter [-] [75478] Writing DB stats cinder:UPDATE=1 {{(pid=75478) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:20:53 devstack cinder-volume[75478]: DEBUG oslo_service.periodic_task [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 11:20:53 devstack cinder-volume[75478]: DEBUG cinder.volume.drivers.lvm [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Updating volume stats {{(pid=75478) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 18 11:20:53 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:20:54 devstack sudo[79129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 11:20:54 devstack sudo[79129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:20:55 devstack sudo[79129]: pam_unix(sudo:session): session closed for user root
Sep 18 11:20:55 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.981s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:20:55 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:20:56 devstack sudo[79135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 11:20:56 devstack sudo[79135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:20:57 devstack sudo[79135]: pam_unix(sudo:session): session closed for user root
Sep 18 11:20:57 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.008s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:20:57 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:20:58 devstack sudo[79138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 11:20:58 devstack sudo[79138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:20:59 devstack sudo[79138]: pam_unix(sudo:session): session closed for user root
Sep 18 11:20:59 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.992s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:20:59 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:21:00 devstack sudo[79141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 11:21:00 devstack sudo[79141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:21:02 devstack sudo[79141]: pam_unix(sudo:session): session closed for user root
Sep 18 11:21:02 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.036s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:21:02 devstack cinder-volume[75478]: DEBUG cinder.manager [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Notifying Schedulers of capabilities ... {{(pid=75478) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:21:53 devstack cinder-volume[75478]: DEBUG oslo_service.periodic_task [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 11:21:53 devstack cinder-volume[75478]: DEBUG cinder.volume.drivers.lvm [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Updating volume stats {{(pid=75478) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 18 11:21:53 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:21:54 devstack sudo[81666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 11:21:54 devstack sudo[81666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:21:55 devstack sudo[81666]: pam_unix(sudo:session): session closed for user root
Sep 18 11:21:55 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.990s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:21:55 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:21:56 devstack sudo[81672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 11:21:56 devstack sudo[81672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:21:57 devstack sudo[81672]: pam_unix(sudo:session): session closed for user root
Sep 18 11:21:57 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.904s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:21:57 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:21:57 devstack sudo[81677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 11:21:57 devstack sudo[81677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:21:59 devstack sudo[81677]: pam_unix(sudo:session): session closed for user root
Sep 18 11:21:59 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.869s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:21:59 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:21:59 devstack sudo[81692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 11:21:59 devstack sudo[81692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:22:01 devstack sudo[81692]: pam_unix(sudo:session): session closed for user root
Sep 18 11:22:01 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.833s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:22:01 devstack cinder-volume[75478]: DEBUG cinder.manager [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Notifying Schedulers of capabilities ... {{(pid=75478) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:22:38 devstack cinder-volume[75478]: DEBUG dbcounter [-] [75478] Writing DB stats cinder:SELECT=1 {{(pid=75478) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:22:38 devstack cinder-volume[75478]: DEBUG dbcounter [-] [75478] Writing DB stats cinder:UPDATE=1 {{(pid=75478) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:22:53 devstack cinder-volume[75478]: DEBUG oslo_service.periodic_task [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 11:22:53 devstack cinder-volume[75478]: DEBUG cinder.volume.drivers.lvm [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Updating volume stats {{(pid=75478) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 18 11:22:53 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:22:54 devstack sudo[81961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 11:22:54 devstack sudo[81961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:22:55 devstack sudo[81961]: pam_unix(sudo:session): session closed for user root
Sep 18 11:22:55 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.983s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:22:55 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:22:56 devstack sudo[81964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 11:22:56 devstack sudo[81964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:22:57 devstack sudo[81964]: pam_unix(sudo:session): session closed for user root
Sep 18 11:22:57 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.781s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:22:57 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:22:57 devstack sudo[81967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 11:22:57 devstack sudo[81967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:22:59 devstack sudo[81967]: pam_unix(sudo:session): session closed for user root
Sep 18 11:22:59 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.823s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:22:59 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:22:59 devstack sudo[81970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 11:22:59 devstack sudo[81970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:23:01 devstack sudo[81970]: pam_unix(sudo:session): session closed for user root
Sep 18 11:23:01 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.095s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:23:01 devstack cinder-volume[75478]: DEBUG cinder.manager [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Notifying Schedulers of capabilities ... {{(pid=75478) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:23:53 devstack cinder-volume[75478]: DEBUG oslo_service.periodic_task [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75478) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 11:23:53 devstack cinder-volume[75478]: DEBUG cinder.volume.drivers.lvm [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Updating volume stats {{(pid=75478) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 18 11:23:53 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:23:54 devstack sudo[82803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 11:23:54 devstack sudo[82803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:23:56 devstack sudo[82803]: pam_unix(sudo:session): session closed for user root
Sep 18 11:23:56 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.798s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:23:56 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:23:56 devstack sudo[82849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 11:23:56 devstack sudo[82849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:23:59 devstack sudo[82849]: pam_unix(sudo:session): session closed for user root
Sep 18 11:23:59 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.591s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:23:59 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:23:59 devstack sudo[82882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 11:23:59 devstack sudo[82882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:24:00 devstack cinder-volume[75380]: INFO oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] Caught SIGTERM, stopping children
Sep 18 11:24:00 devstack cinder-volume[75380]: DEBUG oslo_concurrency.lockutils [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] Acquiring lock "singleton_lock" {{(pid=75380) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 18 11:24:00 devstack cinder-volume[75380]: DEBUG oslo_concurrency.lockutils [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] Acquired lock "singleton_lock" {{(pid=75380) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 18 11:24:00 devstack cinder-volume[75380]: DEBUG oslo_concurrency.lockutils [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] Releasing lock "singleton_lock" {{(pid=75380) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 18 11:24:00 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] Stop services. {{(pid=75380) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:610}}
Sep 18 11:24:00 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] Killing children. {{(pid=75380) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:615}}
Sep 18 11:24:00 devstack cinder-volume[75380]: INFO oslo_service.backend._eventlet.service [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] Waiting on 1 children to exit
Sep 18 11:24:03 devstack sudo[82882]: pam_unix(sudo:session): session closed for user root
Sep 18 11:24:03 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 3.720s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:24:03 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:24:03 devstack sudo[82939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 11:24:03 devstack sudo[82939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:24:05 devstack cinder-volume[75478]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Sep 18 11:24:08 devstack sudo[82939]: pam_unix(sudo:session): session closed for user root
Sep 18 11:24:08 devstack cinder-volume[75478]: DEBUG oslo_concurrency.processutils [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 5.738s {{(pid=75478) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:24:09 devstack cinder-volume[75478]: DEBUG cinder.manager [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Notifying Schedulers of capabilities ... {{(pid=75478) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Unable to connect to AMQP server on 192.168.122.182:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task [None req-d93c5b9f-0f26-4a22-a24e-2076ad5e4d36 None None] Error during VolumeManager.publish_service_capabilities: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.182:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task Traceback (most recent call last):
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1173, in ensure
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task     ret, channel = autoretry_method()
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/connection.py", line 556, in _ensured
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task     return fun(*args, **kwargs)
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/connection.py", line 639, in __call__
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task     return fun(*args, channel=channels[0], **kwargs), channels[0]
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1162, in execute_method
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task     method()
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1624, in _publish
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task     self._producer.publish(
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/messaging.py", line 190, in publish
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task     return _publish(
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/messaging.py", line 214, in _publish
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task     return channel.basic_publish(
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task     self.wait([spec.Basic.Ack, spec.Basic.Nack],
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/abstract_channel.py", line 99, in wait
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task     self.connection.drain_events(timeout=timeout)
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 526, in drain_events
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task     while not self.blocking_read(timeout):
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 532, in blocking_read
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task     return self.on_inbound_frame(frame)
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/method_framing.py", line 53, in on_frame
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task     callback(channel, method_sig, buf, None)
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 538, in on_inbound_method
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task     return self.channels[channel_id].dispatch_method(
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task     listener(*args)
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/channel.py", line 293, in _on_close
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task     raise error_for_code(
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task 
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task During handling of the above exception, another exception occurred:
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task 
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task Traceback (most recent call last):
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task     task(self, context)
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task   File "/opt/stack/cinder/cinder/volume/manager.py", line 2873, in publish_service_capabilities
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task     self._publish_service_capabilities(context)
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task   File "/opt/stack/cinder/cinder/manager.py", line 203, in _publish_service_capabilities
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task     self.scheduler_rpcapi.update_service_capabilities(
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task   File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task     cctxt.cast(ctxt, 'update_service_capabilities', **msg_args)
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/client.py", line 154, in cast
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task     self.transport._send(self.target, msg_ctxt, msg,
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/transport.py", line 123, in _send
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task     return self._driver.send(target, ctxt, message,
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 794, in send
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task     return self._send(target, ctxt, message, wait_for_reply, timeout,
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 769, in _send
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task     conn.fanout_send(target.topic, msg, retry=retry)
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1743, in fanout_send
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task     self._ensure_publishing(self._publish, exchange, msg, retry=retry)
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1575, in _ensure_publishing
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task     self.ensure(method, retry=retry, error_callback=_error_callback)
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1195, in ensure
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task     raise exceptions.MessageDeliveryFailure(msg)
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.182:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Sep 18 11:24:09 devstack cinder-volume[75478]: ERROR oslo_service.periodic_task 
Sep 18 11:24:09 devstack cinder-volume[75478]: DEBUG oslo_concurrency.lockutils [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] Acquiring lock "singleton_lock" {{(pid=75478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 18 11:24:09 devstack cinder-volume[75478]: DEBUG oslo_concurrency.lockutils [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] Acquired lock "singleton_lock" {{(pid=75478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 18 11:24:09 devstack cinder-volume[75478]: DEBUG oslo_concurrency.lockutils [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] Releasing lock "singleton_lock" {{(pid=75478) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 18 11:24:09 devstack cinder-volume[75478]: WARNING amqp [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 18 11:24:09 devstack cinder-volume[75478]: WARNING amqp [None req-f78d815b-b05f-4376-abf3-10ff98a0c63e None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 18 11:24:23 devstack cinder-volume[82951]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82951) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 18 11:24:23 devstack cinder-volume[82951]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82951) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 18 11:24:23 devstack cinder-volume[82951]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82951) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 18 11:24:26 devstack cinder-volume[82951]: INFO dbcounter [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] Registered counter for database cinder
Sep 18 11:24:26 devstack cinder-volume[82951]: DEBUG oslo_db.sqlalchemy.engines [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82951) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 18 11:24:27 devstack cinder-volume[82951]: DEBUG dbcounter [-] [82951] Writer thread running {{(pid=82951) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 18 11:24:27 devstack cinder-volume[82951]: INFO cinder.rpc [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 18 11:24:27 devstack cinder-volume[82951]: INFO cinder.rpc [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 18 11:24:27 devstack cinder-volume[82951]: DEBUG oslo_db.sqlalchemy.engines [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82951) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 18 11:24:27 devstack cinder-volume[82951]: INFO cinder.volume.manager [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] Determined volume DB was empty at startup.
Sep 18 11:24:27 devstack cinder-volume[82951]: DEBUG cinder.volume.manager [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82951) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 18 11:24:28 devstack cinder-volume[82951]: INFO cinder.volume.manager [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 18 11:24:28 devstack cinder-volume[82951]: WARNING stevedore.named [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 18 11:24:28 devstack cinder-volume[82951]: WARNING castellan.key_manager [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 18 11:24:28 devstack cinder-volume[82951]: WARNING cinder.keymgr.conf_key_mgr [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 18 11:24:28 devstack cinder-volume[82951]: INFO cinder.volume.manager [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_db.sqlalchemy.engines [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82951) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 18 11:24:28 devstack cinder-volume[82951]: INFO oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] Starting 1 workers
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] Started child 83176 {{(pid=82951) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] Full set of CONF: {{(pid=82951) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] ******************************************************************************** {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] Configuration options gathered from: {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] ================================================================================ {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] allow_availability_zone_fallback = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] allow_compression_on_image_upload = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] allowed_direct_url_schemes     = [] {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] api_rate_limit                 = True {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] auth_strategy                  = keystone {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_availability_zone      = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_host                   = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_name                   = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_stats_polling_interval = 60 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backup_api_class               = cinder.backup.api.API {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backup_name_template           = backup-%s {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backup_use_same_host           = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backup_use_temp_snapshot       = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] chap_password                  = **** {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] chap_username                  =  {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cinder_internal_tenant_project_id = 71b16d157cf64fc98fdffbc74bc7dcda {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cinder_internal_tenant_user_id = 2abc72dd6d844c58af5130ff976e08c3 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cluster                        = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] compression_format             = gzip {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] compute_api_class              = cinder.compute.nova.API {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] config_dir                     = [] {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] config_source                  = [] {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] control_exchange               = openstack {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] debug                          = True {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] default_availability_zone      = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] default_group_type             = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] default_volume_type            = QuobyteHD {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] driver_client_cert             = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] driver_client_cert_key         = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] driver_data_namespace          = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] driver_ssl_cert_path           = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] driver_ssl_cert_verify         = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] driver_use_ssl                 = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] enable_new_services            = True {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] enable_unsupported_driver      = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] enabled_backends               = ['QuobyteHD'] {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] enforce_multipath_for_image_xfer = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] filter_function                = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] glance_api_insecure            = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] glance_api_servers             = ['http://192.168.122.182/image'] {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] glance_api_ssl_compression     = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] glance_ca_certificates_file    = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] glance_catalog_info            = image:glance:publicURL {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] glance_certfile                = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] glance_keyfile                 = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] glance_num_retries             = 3 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] glance_request_timeout         = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] goodness_function              = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] graceful_shutdown_timeout      = 5 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] group_api_class                = cinder.group.api.API {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] host                           = devstack {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] image_compress_on_upload       = True {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] image_conversion_address_space_limit = 1 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] image_conversion_cpu_limit     = 60 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] image_conversion_disable       = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] image_upload_use_cinder_backend = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] image_upload_use_internal_tenant = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] image_volume_cache_enabled     = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] image_volume_cache_max_count   = 0 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] image_volume_cache_max_size_gb = 0 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] init_host_max_objects_retrieval = 0 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] instance_format                = [instance: %(uuid)s]  {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] iscsi_iotype                   = fileio {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] iscsi_target_flags             =  {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[83176]: INFO cinder.service [-] Starting cinder-volume node (version 27.0.0)
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] iscsi_write_cache              = on {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] iser_helper                    = tgtadm {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] iser_ip_address                = 192.168.122.182 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] iser_port                      = 3260 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] log_color                      = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] log_config_append              = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] log_dir                        = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] log_file                       = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] log_options                    = True {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] log_rotate_interval            = 1 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] log_rotate_interval_type       = days {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] log_rotation_type              = none {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] max_age                        = 0 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] max_logfile_count              = 30 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] max_logfile_size_mb            = 200 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] max_over_subscription_ratio    = 20.0 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] message_reap_interval          = 86400 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] message_ttl                    = 2592000 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] migration_create_volume_timeout_secs = 300 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] monkey_patch                   = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] monkey_patch_modules           = [] {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] my_ip                          = 192.168.122.182 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] no_snapshot_gb_quota           = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] num_iser_scan_tries            = 3 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] num_shell_tries                = 3 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] num_volume_device_scan_tries   = 3 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] nvmeof_conn_info_version       = 1 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] nvmet_ns_id                    = 10 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] nvmet_port_id                  = 1 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] osapi_max_limit                = 1000 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] osapi_volume_ext_list          = [] {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] osapi_volume_listen_port       = 8776 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] osapi_volume_use_ssl           = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] osapi_volume_workers           = 2 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] per_volume_size_limit          = -1 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] periodic_fuzzy_delay           = 60 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] periodic_interval              = 60 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] public_endpoint                = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] publish_errors                 = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] quota_backup_gigabytes         = 1000 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] quota_backups                  = 10 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] quota_gigabytes                = 1000 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] quota_groups                   = 10 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] quota_snapshots                = 10 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] quota_volumes                  = 10 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] rate_limit_burst               = 0 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] rate_limit_except_level        = CRITICAL {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] rate_limit_interval            = 0 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] reinit_driver_count            = 3 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] replication_device             = **** {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] report_discard_supported       = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] report_interval                = 120 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] reservation_clean_interval     = 86400 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] reservation_expire             = 86400 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] reserved_image_namespaces      = [] {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] reserved_percentage            = 0 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] rpc_response_timeout           = 120 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] run_external_periodic_tasks    = True {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:28 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] scst_target_driver             = iscsi {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] scst_target_iqn_name           = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] service_down_time              = 720 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] shell_completion               = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] snapshot_name_template         = snapshot-%s {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] split_loggers                  = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] state_path                     = /opt/stack/data/cinder {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] storage_availability_zone      = nova {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] storage_protocol               = iSCSI {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] syslog_log_facility            = LOG_USER {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] target_helper                  = lioadm {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] target_ip_address              = 192.168.122.182 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] target_port                    = 3260 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] target_protocol                = iscsi {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] target_secondary_ip_addresses  = [] {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] trace_flags                    = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] transport_url                  = **** {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] until_refresh                  = 0 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] use_chap_auth                  = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] use_default_quota_class        = True {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] use_journal                    = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] use_json                       = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] use_multipath_for_image_xfer   = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] use_stderr                     = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] use_syslog                     = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] verify_glance_signatures       = enabled {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] volume_api_class               = cinder.volume.api.API {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] volume_backend_name            = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] volume_clear                   = zero {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] volume_clear_ionice            = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] volume_clear_size              = 0 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] volume_copy_bps_limit          = 0 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] volume_dd_blocksize            = 1M {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] volume_name_template           = volume-%s {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] volume_service_inithost_offload = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] volume_usage_audit_period      = month {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] watch_log_file                 = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] zoning_mode                    = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_concurrency.disable_process_locking = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.admin_password = **** {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.admin_token = **** {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.admin_user  = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.auth_port   = 35357 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.auth_protocol = https {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.auth_section = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.auth_type   = password {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.auth_uri    = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.auth_version = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.cache       = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.certfile    = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.delay_auth_decision = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.http_connect_timeout = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.identity_uri = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.include_service_catalog = True {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.insecure    = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.interface   = public {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.keyfile     = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.memcache_password =  {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.memcache_username =  {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.region_name = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.service_token_roles_required = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.service_type = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.token_cache_time = 300 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] keystone_authtoken.www_authenticate_uri = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cache.backend                  = dogpile.cache.null {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cache.backend_argument         = **** {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cache.backend_expiration_time  = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cache.config_prefix            = cache.oslo {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cache.dead_timeout             = 60.0 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cache.debug_cache_backend      = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cache.enable_retry_client      = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cache.enable_socket_keepalive  = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cache.enabled                  = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cache.enforce_fips_mode        = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cache.expiration_time          = 600 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cache.hashclient_retry_attempts = 2 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cache.hashclient_retry_delay   = 1.0 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cache.memcache_dead_retry      = 300 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cache.memcache_password        = **** {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cache.memcache_pool_maxsize    = 10 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cache.memcache_sasl_enabled    = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cache.memcache_socket_timeout  = 1.0 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cache.memcache_username        = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cache.proxies                  = [] {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cache.redis_db                 = 0 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cache.redis_password           = **** {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cache.redis_sentinel_service_name = mymaster {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cache.redis_server             = localhost:6379 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cache.redis_socket_timeout     = 1.0 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cache.redis_username           = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cache.retry_attempts           = 2 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cache.retry_delay              = 0.0 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cache.socket_keepalive_count   = 1 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cache.socket_keepalive_idle    = 1 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cache.socket_keepalive_interval = 1 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cache.tls_allowed_ciphers      = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cache.tls_cafile               = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cache.tls_certfile             = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cache.tls_enabled              = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cache.tls_keyfile              = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] coordination.backend_url       = **** {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] database.asyncio_connection    = **** {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] database.asyncio_slave_connection = **** {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] database.backend               = sqlalchemy {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] database.connection            = **** {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] database.connection_debug      = 0 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] database.connection_parameters =  {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] database.connection_recycle_time = 3600 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] database.connection_trace      = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] database.db_inc_retry_interval = True {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] database.db_max_retries        = 20 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] database.db_max_retry_interval = 10 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] database.db_retry_interval     = 1 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] database.max_overflow          = 50 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] database.max_pool_size         = 5 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] database.max_retries           = 10 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] database.mysql_wsrep_sync_wait = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] database.pool_timeout          = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] database.retry_interval        = 10 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] database.slave_connection      = **** {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] database.sqlite_synchronous    = True {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] database.use_db_reconnect      = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] profiler.connection_string     = messaging:// {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] profiler.enabled               = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] profiler.es_doc_type           = notification {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] profiler.es_scroll_size        = 10000 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] profiler.es_scroll_time        = 2m {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] profiler.filter_error_trace    = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] profiler.hmac_keys             = **** {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] profiler.sentinel_service_name = mymaster {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] profiler.socket_timeout        = 0.1 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] profiler.trace_requests        = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] profiler.trace_sqlalchemy      = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] profiler_jaeger.process_tags   = {} {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] profiler_jaeger.service_name_prefix = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] profiler_otlp.service_name_prefix = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_policy.enforce_new_defaults = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: WARNING oslo_config.cfg [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_policy.enforce_scope      = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_policy.policy_default_rule = default {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_policy.policy_file        = policy.yaml {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] privsep_osbrick.group          = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] privsep_osbrick.helper_command = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] privsep_osbrick.thread_pool_size = 3 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] privsep_osbrick.user           = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cinder_sys_admin.group         = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cinder_sys_admin.helper_command = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] cinder_sys_admin.user          = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] service_user.auth_section      = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] service_user.auth_type         = password {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] service_user.certfile          = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] service_user.collect_timing    = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] service_user.insecure          = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] service_user.keyfile           = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] service_user.send_service_user_token = True {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] service_user.split_loggers     = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] service_user.timeout           = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] glance.auth_section            = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] glance.auth_type               = password {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] glance.certfile                = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] glance.collect_timing          = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] glance.insecure                = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] glance.keyfile                 = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] glance.split_loggers           = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] glance.timeout                 = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.backend_availability_zone = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.chap_password = **** {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.chap_username =  {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.driver_client_cert = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.driver_client_cert_key = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.driver_data_namespace = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.driver_use_ssl = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.enable_unsupported_driver = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.extra_capabilities = {} {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.filter_function = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.goodness_function = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.iscsi_iotype  = fileio {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.iscsi_target_flags =  {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.iscsi_write_cache = on {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.iser_helper   = tgtadm {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.iser_ip_address = 192.168.122.182 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.iser_port     = 3260 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.nas_host      =  {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.nas_login     = admin {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.nas_mount_options = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.nas_password  = **** {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.nas_private_key =  {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.nas_share_path =  {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.num_shell_tries = 3 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.nvmet_port_id = 1 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.quobyte_client_cfg = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.quobyte_volume_url = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.replication_device = **** {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.report_discard_supported = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.reserved_percentage = 0 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.scst_target_driver = iscsi {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.scst_target_iqn_name = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.storage_protocol = iSCSI {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.target_helper = tgtadm {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.target_ip_address = 192.168.122.182 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.target_port   = 3260 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.target_protocol = iscsi {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.trace_flags   = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.unique_fqdn_network = True {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.use_chap_auth = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.volume_backend_name = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.volume_clear  = zero {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.volume_clear_ionice = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.volume_clear_size = 0 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_reports.file_event_handler = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_reports.log_dir           = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.backend_availability_zone = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.backend_host         = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.chap_password        = **** {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.chap_username        = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.chiscsi_conf         = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.driver_client_cert   = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.driver_client_cert_key = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.driver_data_namespace = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.driver_use_ssl       = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.extra_capabilities   = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.filter_function      = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.goodness_function    = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.iscsi_iotype         = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.iser_helper          = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.iser_ip_address      = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.iser_port            = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.iser_target_prefix   = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.nas_host             = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.nas_login            = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.nas_mount_options    = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.nas_password         = **** {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.nas_private_key      = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.nas_secure_file_operations = true {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [-] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:24:29 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] Starting volume driver QuobyteDriver (1.1.13)
Sep 18 11:24:29 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] NAS config: {'nas_secure_file_permissions': 'true', 'nas_secure_file_operations': 'true'} {{(pid=83176) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:223}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.nas_secure_file_permissions = true {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.nas_share_path       = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.nas_ssh_port         = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.num_shell_tries      = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.nvmet_port_id        = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.quobyte_volume_url   = quobyte://10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.replication_device   = **** {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.report_discard_supported = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.reserved_percentage  = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.scst_target_driver   = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.storage_protocol     = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.target_helper        = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.target_ip_address    = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.target_port          = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.target_prefix        = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.target_protocol      = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.trace_flags          = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.use_chap_auth        = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.volume_clear         = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.volume_clear_size    = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] QuobyteHD.volumes_dir          = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_rabbit.ssl      = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_notifications.driver = [] {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_notifications.retry = -1 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] oslo_messaging_notifications.transport_url = **** {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] key_manager.fixed_key          = **** {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] barbican.barbican_api_version  = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] barbican.barbican_endpoint     = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] barbican.barbican_endpoint_type = public {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] barbican.barbican_region_name  = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] barbican.cafile                = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] barbican.certfile              = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] barbican.collect_timing        = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] barbican.insecure              = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] barbican.keyfile               = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] barbican.number_of_retries     = 60 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] barbican.retry_delay           = 1 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] barbican.send_service_user_token = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] barbican.split_loggers         = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] barbican.timeout               = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] barbican.verify_ssl            = True {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] barbican.verify_ssl_path       = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] barbican_service_user.auth_section = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] barbican_service_user.auth_type = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] barbican_service_user.cafile   = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] barbican_service_user.certfile = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] barbican_service_user.collect_timing = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] barbican_service_user.insecure = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] barbican_service_user.keyfile  = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] barbican_service_user.split_loggers = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] barbican_service_user.timeout  = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] vault.approle_role_id          = **** {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] vault.approle_secret_id        = **** {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] vault.kv_mountpoint            = secret {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] vault.kv_path                  = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] vault.kv_version               = 2 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] vault.namespace                = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] vault.root_token_id            = **** {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] vault.ssl_ca_crt_file          = None {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] vault.timeout                  = 60.0 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] vault.use_ssl                  = False {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 11:24:29 devstack cinder-volume[82951]: DEBUG oslo_service.backend._eventlet.service [None req-7a9cdc75-0347-408e-9fde-397e2ac3a2dd None None] ******************************************************************************** {{(pid=82951) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 18 11:24:29 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] nas_secure_file_* settings are true (ownership) and true (permissions). {{(pid=83176) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}}
Sep 18 11:24:29 devstack cinder-volume[83176]: INFO cinder.volume.drivers.quobyte [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] The NAS file operations will be run as non privileged user in secure mode. Please ensure your libvirtd settings have been configured accordingly (see section 'OpenStack' in the Quobyte Manual.
Sep 18 11:24:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] Running cmd (subprocess): mount.quobyte {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:24:30 devstack quobyte-client[83184]: Reading configuration file: /etc/quobyte/client.cfg
Sep 18 11:24:30 devstack quobyte-client[83184]: Invalid parameters found, error: missing mount point.
Sep 18 11:24:30 devstack quobyte-client[83184]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 18 11:24:30 devstack quobyte-client[83184]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Sep 18 11:24:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] CMD "mount.quobyte" returned: 1 in 0.416s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:24:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:24:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:24:30 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:24:30 devstack cinder-volume[83176]: INFO cinder.volume.drivers.quobyte [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] Mounting volume: 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 ...
Sep 18 11:24:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] Running cmd (subprocess): mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b -c /etc/quobyte/client-cinder.cfg {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:24:30 devstack quobyte-client[83188]: Reading configuration file: /etc/quobyte/client-cinder.cfg
Sep 18 11:24:30 devstack quobyte-client[83188]: Reading configuration file: /etc/quobyte/client.cfg
Sep 18 11:24:30 devstack quobyte-client[83188]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b' to display the log.
Sep 18 11:24:30 devstack quobyte-client[83193]: OptimizeSystemPlacement: Increasing priority of client. If your workload does not perform well, please disable the process placement heuristic (remove --enable_process_placement_heuristic).
Sep 18 11:24:30 devstack quobyte-client[83193]: mount.quobyte 3.25 (4fbbd59204)
Sep 18 11:24:30 devstack quobyte-client[83193]: Client UUID: J152TXsJ-MT2m-aUKT-RBZU-VegHsnNiPmvU
Sep 18 11:24:30 devstack quobyte-client[83193]: Registry: osci01.corp.quobyte.com:7861
Sep 18 11:24:30 devstack quobyte-client[83193]: Volume: cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:24:30 devstack quobyte-client[83193]: FUSE version: 316
Sep 18 11:24:30 devstack quobyte-client[83193]: Breakpad initialized (dumping to /home/quobyte/.quobyte/minidumps)
Sep 18 11:24:30 devstack quobyte-client[83193]: Could not set oom_score_adj to default value: Failed to set oom_score_adj -700: 13: Permission denied
Sep 18 11:24:30 devstack quobyte-client[83193]: Setting total object cache size to 3352297472 bytes
Sep 18 11:24:30 devstack quobyte-client[83193]: Using FUSE low-level API
Sep 18 11:24:30 devstack quobyte-client[83193]: Caching of uid/gid to user/group name mappings is enabled
Sep 18 11:24:30 devstack quobyte-client[83193]: Setting up sockets network client, connect timeout (s): 2 linger timeout (s): 1200 request timeout granularity (s): 10
Sep 18 11:24:30 devstack quobyte-client[83193]: Your limit for concurrently opened files ("ulimit -n") is set to 2048. This is too low for the Quobyte client to function properly, and should be set to at least 16384. You can use ulimit, change the system settings or try to use the limit-nofile= option when trying to mount using /etc/fstab.
Sep 18 11:24:30 devstack quobyte-client[83193]: HTTP server started on port 55000
Sep 18 11:24:30 devstack quobyte-client[83193]: Caching mappings from uid/gid to user/group name and group membership temporarily.
Sep 18 11:24:31 devstack quobyte-client[83193]: Mount point /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b established
Sep 18 11:24:31 devstack quobyte-client[83193]: TimeSync is running and remote sync every 60 seconds
Sep 18 11:24:31 devstack quobyte-client[83193]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 18 11:24:31 devstack quobyte-client[83193]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 18 11:24:31 devstack quobyte-client[83193]: Opening volume cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 (a52b8242-31e0-4aec-a351-c1a6cf8fe36f)
Sep 18 11:24:31 devstack quobyte-client[83193]: Setting metadata cache size to 500000 based on available system memory of 16 GiB
Sep 18 11:24:31 devstack quobyte-client[83193]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 18 11:24:31 devstack quobyte-client[83193]: Failed to invalidate inode: 38: Function not implemented
Sep 18 11:24:31 devstack quobyte-client[83193]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 18 11:24:31 devstack quobyte-client[83193]: Automatic minidump upload enabled by global system configuration
Sep 18 11:24:31 devstack quobyte-client[83193]: Announcing HTTP status server address 172.24.4.1
Sep 18 11:24:31 devstack quobyte-client[83193]: Registered as service (uuid J152TXsJ-MT2m-aUKT-RBZU-VegHsnNiPmvU)
Sep 18 11:24:31 devstack quobyte-client[83193]: Quobyte Client running as pid 83193
Sep 18 11:24:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] CMD "mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b -c /etc/quobyte/client-cinder.cfg" returned: 0 in 1.004s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:24:31 devstack quobyte-client[83193]: FUSE announces support for async read, posix locks, atomic O_TRUNC, export support, don't mask, splice write, splice move, splice read, flock, directory ioctl, auto invalidate data, readdir plus, readdir plus auto, async direct IO, writeback cache, no open support, parallel dirops, posix acl, handle killpriv, handle killpriv2
Sep 18 11:24:31 devstack cinder-volume[83176]: INFO cinder.volume.drivers.quobyte [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] Mounting volume: 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 succeeded
Sep 18 11:24:31 devstack quobyte-client[83193]: FUSE capabilities enabled: async read, posix locks, atomic O_TRUNC, don't mask, flock, readdir plus, async direct IO, posix acl
Sep 18 11:24:31 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:24:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 1.107s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:24:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:24:31 devstack quobyte-client[83193]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 18 11:24:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.156s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:24:31 devstack cinder-volume[83176]: INFO cinder.volume.driver [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] Driver hasn't implemented _init_vendor_properties()
Sep 18 11:24:31 devstack cinder-volume[83176]: DEBUG cinder.volume.driver [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9154739379883, 'free_capacity_gb': 924.9154739379883, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83176) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}}
Sep 18 11:24:31 devstack cinder-volume[83176]: DEBUG oslo_db.sqlalchemy.engines [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83176) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 18 11:24:32 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writer thread running {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 18 11:24:32 devstack cinder-volume[83176]: DEBUG cinder.db.sqlalchemy.api [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] Building query based on filter {{(pid=83176) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 18 11:24:32 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83176) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 18 11:24:32 devstack cinder-volume[83176]: INFO cinder.keymgr.migration [None req-c5a87619-406d-4965-895e-44ddb7030840 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 18 11:24:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:24:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:24:32 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:24:32 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:24:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:24:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:24:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.119s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:24:32 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:24:32 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] Driver initialization completed successfully.
Sep 18 11:24:32 devstack cinder-volume[83176]: INFO cinder.manager [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] Initiating service 3 cleanup
Sep 18 11:24:32 devstack cinder-volume[83176]: INFO cinder.manager [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] Service 3 cleanup completed.
Sep 18 11:24:32 devstack cinder-volume[83176]: DEBUG cinder.service [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] Creating RPC server for service cinder-volume {{(pid=83176) start /opt/stack/cinder/cinder/service.py:239}}
Sep 18 11:24:32 devstack cinder-volume[83176]: DEBUG cinder.service [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83176) start /opt/stack/cinder/cinder/service.py:245}}
Sep 18 11:24:33 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.13)
Sep 18 11:24:33 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:24:33 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:24:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:24:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:24:33 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:24:33 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:24:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:24:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:24:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.146s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:24:33 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-604a8654-861e-43fb-8bb4-caacd26d77fe None None] Driver post RPC initialization completed successfully.
Sep 18 11:24:33 devstack quobyte-client[83193]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 18 11:24:38 devstack cinder-volume[82951]: DEBUG dbcounter [-] [82951] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82951) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:24:42 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:24:43 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:25:53 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-2372e5fe-9ba4-45f6-940e-1db5dec3531c tempest-VolumesAssistedSnapshotsTest-1430508158 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:25:53 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-2372e5fe-9ba4-45f6-940e-1db5dec3531c tempest-VolumesAssistedSnapshotsTest-1430508158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:25:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2372e5fe-9ba4-45f6-940e-1db5dec3531c tempest-VolumesAssistedSnapshotsTest-1430508158 None] Flow 'volume_create_manager' (5ab20ca0-0fae-4ed9-ac8e-d66019b450cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:25:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2372e5fe-9ba4-45f6-940e-1db5dec3531c tempest-VolumesAssistedSnapshotsTest-1430508158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d1f0242-1fad-4d6c-bd4e-ed80cb3fb8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:25:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2372e5fe-9ba4-45f6-940e-1db5dec3531c tempest-VolumesAssistedSnapshotsTest-1430508158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d1f0242-1fad-4d6c-bd4e-ed80cb3fb8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-1682014193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb219d6a-d345-4b0f-85ce-2205e89595c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acb3f0aeafd143f8af2ce527f4beb83c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:25:53Z,use_quota=True,user_id='b1c653383640429eb9c56749fdceb579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:25:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2372e5fe-9ba4-45f6-940e-1db5dec3531c tempest-VolumesAssistedSnapshotsTest-1430508158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83203542-8378-402e-9f3f-9ab583e23c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:25:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2372e5fe-9ba4-45f6-940e-1db5dec3531c tempest-VolumesAssistedSnapshotsTest-1430508158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83203542-8378-402e-9f3f-9ab583e23c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:25:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2372e5fe-9ba4-45f6-940e-1db5dec3531c tempest-VolumesAssistedSnapshotsTest-1430508158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e893befa-67d5-494a-9537-62e00a31e67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:25:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2372e5fe-9ba4-45f6-940e-1db5dec3531c tempest-VolumesAssistedSnapshotsTest-1430508158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e893befa-67d5-494a-9537-62e00a31e67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb219d6a-d345-4b0f-85ce-2205e89595c9', 'volume_name': 'volume-fb219d6a-d345-4b0f-85ce-2205e89595c9', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:25:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2372e5fe-9ba4-45f6-940e-1db5dec3531c tempest-VolumesAssistedSnapshotsTest-1430508158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af813b7d-3a70-4ecc-be9b-ec6c635cc2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:25:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2372e5fe-9ba4-45f6-940e-1db5dec3531c tempest-VolumesAssistedSnapshotsTest-1430508158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af813b7d-3a70-4ecc-be9b-ec6c635cc2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:25:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2372e5fe-9ba4-45f6-940e-1db5dec3531c tempest-VolumesAssistedSnapshotsTest-1430508158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c976d017-5267-4e9c-81ca-57fd0a9fb2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:25:53 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-2372e5fe-9ba4-45f6-940e-1db5dec3531c tempest-VolumesAssistedSnapshotsTest-1430508158 None] Volume fb219d6a-d345-4b0f-85ce-2205e89595c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb219d6a-d345-4b0f-85ce-2205e89595c9', 'volume_size': 1}
Sep 18 11:25:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-2372e5fe-9ba4-45f6-940e-1db5dec3531c tempest-VolumesAssistedSnapshotsTest-1430508158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:25:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-2372e5fe-9ba4-45f6-940e-1db5dec3531c tempest-VolumesAssistedSnapshotsTest-1430508158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:25:53 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-2372e5fe-9ba4-45f6-940e-1db5dec3531c tempest-VolumesAssistedSnapshotsTest-1430508158 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-1682014193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb219d6a-d345-4b0f-85ce-2205e89595c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acb3f0aeafd143f8af2ce527f4beb83c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:25:53Z,use_quota=True,user_id='b1c653383640429eb9c56749fdceb579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:25:53 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-2372e5fe-9ba4-45f6-940e-1db5dec3531c tempest-VolumesAssistedSnapshotsTest-1430508158 None] Creating volume fb219d6a-d345-4b0f-85ce-2205e89595c9 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:25:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-2372e5fe-9ba4-45f6-940e-1db5dec3531c tempest-VolumesAssistedSnapshotsTest-1430508158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:25:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-2372e5fe-9ba4-45f6-940e-1db5dec3531c tempest-VolumesAssistedSnapshotsTest-1430508158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:25:53 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-2372e5fe-9ba4-45f6-940e-1db5dec3531c tempest-VolumesAssistedSnapshotsTest-1430508158 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:25:53 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-2372e5fe-9ba4-45f6-940e-1db5dec3531c tempest-VolumesAssistedSnapshotsTest-1430508158 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:25:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-2372e5fe-9ba4-45f6-940e-1db5dec3531c tempest-VolumesAssistedSnapshotsTest-1430508158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:25:53 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-2372e5fe-9ba4-45f6-940e-1db5dec3531c tempest-VolumesAssistedSnapshotsTest-1430508158 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:25:53 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-2372e5fe-9ba4-45f6-940e-1db5dec3531c tempest-VolumesAssistedSnapshotsTest-1430508158 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:25:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2372e5fe-9ba4-45f6-940e-1db5dec3531c tempest-VolumesAssistedSnapshotsTest-1430508158 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-fb219d6a-d345-4b0f-85ce-2205e89595c9 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:25:53 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=2, name=volume-fb219d6a-d345-4b0f-85ce-2205e89595c9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:25:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2372e5fe-9ba4-45f6-940e-1db5dec3531c tempest-VolumesAssistedSnapshotsTest-1430508158 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-fb219d6a-d345-4b0f-85ce-2205e89595c9 1073741824" returned: 0 in 0.901s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:25:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2372e5fe-9ba4-45f6-940e-1db5dec3531c tempest-VolumesAssistedSnapshotsTest-1430508158 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-fb219d6a-d345-4b0f-85ce-2205e89595c9 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:25:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2372e5fe-9ba4-45f6-940e-1db5dec3531c tempest-VolumesAssistedSnapshotsTest-1430508158 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-fb219d6a-d345-4b0f-85ce-2205e89595c9" returned: 0 in 0.220s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:25:54 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-2372e5fe-9ba4-45f6-940e-1db5dec3531c tempest-VolumesAssistedSnapshotsTest-1430508158 None] <== create_volume: return (1195ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:25:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-2372e5fe-9ba4-45f6-940e-1db5dec3531c tempest-VolumesAssistedSnapshotsTest-1430508158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:25:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2372e5fe-9ba4-45f6-940e-1db5dec3531c tempest-VolumesAssistedSnapshotsTest-1430508158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c976d017-5267-4e9c-81ca-57fd0a9fb2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb219d6a-d345-4b0f-85ce-2205e89595c9', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:25:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2372e5fe-9ba4-45f6-940e-1db5dec3531c tempest-VolumesAssistedSnapshotsTest-1430508158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7198e7f-5313-4780-b2a4-e47d34235348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:25:54 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-2372e5fe-9ba4-45f6-940e-1db5dec3531c tempest-VolumesAssistedSnapshotsTest-1430508158 None] Volume volume-fb219d6a-d345-4b0f-85ce-2205e89595c9 (fb219d6a-d345-4b0f-85ce-2205e89595c9): created successfully
Sep 18 11:25:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2372e5fe-9ba4-45f6-940e-1db5dec3531c tempest-VolumesAssistedSnapshotsTest-1430508158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7198e7f-5313-4780-b2a4-e47d34235348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:25:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2372e5fe-9ba4-45f6-940e-1db5dec3531c tempest-VolumesAssistedSnapshotsTest-1430508158 None] Flow 'volume_create_manager' (5ab20ca0-0fae-4ed9-ac8e-d66019b450cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:25:55 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-2372e5fe-9ba4-45f6-940e-1db5dec3531c tempest-VolumesAssistedSnapshotsTest-1430508158 None] Created volume successfully.
Sep 18 11:26:05 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:26:05 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:26:13 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 11:26:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:26:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:26:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:26:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:26:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:26:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:26:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.306s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:26:14 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:26:43 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:26:44 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:UPDATE=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:27:13 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 11:27:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:27:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:27:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:27:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:27:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:27:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:27:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.112s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:27:13 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:27:48 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-3cbb9d06-007c-4b9b-93ab-968e2242a04d tempest-AttachVolumeTestJSON-1453990575 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:27:48 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cbb9d06-007c-4b9b-93ab-968e2242a04d tempest-AttachVolumeTestJSON-1453990575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:27:48 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3cbb9d06-007c-4b9b-93ab-968e2242a04d tempest-AttachVolumeTestJSON-1453990575 None] Flow 'volume_create_manager' (c1e491d5-31b1-41bc-ab37-f93907419dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:27:48 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3cbb9d06-007c-4b9b-93ab-968e2242a04d tempest-AttachVolumeTestJSON-1453990575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c050f1b-c3c3-4c94-a080-b34b651d70e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:27:48 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3cbb9d06-007c-4b9b-93ab-968e2242a04d tempest-AttachVolumeTestJSON-1453990575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c050f1b-c3c3-4c94-a080-b34b651d70e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1547033601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74cf6b74-0ac1-4d0d-9958-650a0b66114d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a8a837e06b4e66ae9eee5d6b4ead52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:27:48Z,use_quota=True,user_id='af8eee920c034ce78c561706f3fec005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:27:48 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3cbb9d06-007c-4b9b-93ab-968e2242a04d tempest-AttachVolumeTestJSON-1453990575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a05c0e86-30b6-4e14-85d6-2d770c073134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:27:48 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3cbb9d06-007c-4b9b-93ab-968e2242a04d tempest-AttachVolumeTestJSON-1453990575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a05c0e86-30b6-4e14-85d6-2d770c073134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:27:48 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3cbb9d06-007c-4b9b-93ab-968e2242a04d tempest-AttachVolumeTestJSON-1453990575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd3a8d5c-5117-4c6c-b231-32de2e679093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:27:48 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3cbb9d06-007c-4b9b-93ab-968e2242a04d tempest-AttachVolumeTestJSON-1453990575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd3a8d5c-5117-4c6c-b231-32de2e679093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74cf6b74-0ac1-4d0d-9958-650a0b66114d', 'volume_name': 'volume-74cf6b74-0ac1-4d0d-9958-650a0b66114d', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:27:48 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3cbb9d06-007c-4b9b-93ab-968e2242a04d tempest-AttachVolumeTestJSON-1453990575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f2767ba-aefc-4f61-a9b7-12898515f29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:27:48 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3cbb9d06-007c-4b9b-93ab-968e2242a04d tempest-AttachVolumeTestJSON-1453990575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f2767ba-aefc-4f61-a9b7-12898515f29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:27:49 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3cbb9d06-007c-4b9b-93ab-968e2242a04d tempest-AttachVolumeTestJSON-1453990575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c83f36-7efd-44c2-9cd6-f2023b253d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:27:49 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-3cbb9d06-007c-4b9b-93ab-968e2242a04d tempest-AttachVolumeTestJSON-1453990575 None] Volume 74cf6b74-0ac1-4d0d-9958-650a0b66114d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74cf6b74-0ac1-4d0d-9958-650a0b66114d', 'volume_size': 1}
Sep 18 11:27:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-3cbb9d06-007c-4b9b-93ab-968e2242a04d tempest-AttachVolumeTestJSON-1453990575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:27:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-3cbb9d06-007c-4b9b-93ab-968e2242a04d tempest-AttachVolumeTestJSON-1453990575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:27:49 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-3cbb9d06-007c-4b9b-93ab-968e2242a04d tempest-AttachVolumeTestJSON-1453990575 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1547033601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74cf6b74-0ac1-4d0d-9958-650a0b66114d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a8a837e06b4e66ae9eee5d6b4ead52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:27:48Z,use_quota=True,user_id='af8eee920c034ce78c561706f3fec005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:27:49 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-3cbb9d06-007c-4b9b-93ab-968e2242a04d tempest-AttachVolumeTestJSON-1453990575 None] Creating volume 74cf6b74-0ac1-4d0d-9958-650a0b66114d {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:27:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-3cbb9d06-007c-4b9b-93ab-968e2242a04d tempest-AttachVolumeTestJSON-1453990575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:27:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-3cbb9d06-007c-4b9b-93ab-968e2242a04d tempest-AttachVolumeTestJSON-1453990575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:27:49 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-3cbb9d06-007c-4b9b-93ab-968e2242a04d tempest-AttachVolumeTestJSON-1453990575 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:27:49 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-3cbb9d06-007c-4b9b-93ab-968e2242a04d tempest-AttachVolumeTestJSON-1453990575 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:27:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-3cbb9d06-007c-4b9b-93ab-968e2242a04d tempest-AttachVolumeTestJSON-1453990575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:27:49 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-3cbb9d06-007c-4b9b-93ab-968e2242a04d tempest-AttachVolumeTestJSON-1453990575 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:27:49 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-3cbb9d06-007c-4b9b-93ab-968e2242a04d tempest-AttachVolumeTestJSON-1453990575 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:27:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-3cbb9d06-007c-4b9b-93ab-968e2242a04d tempest-AttachVolumeTestJSON-1453990575 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-74cf6b74-0ac1-4d0d-9958-650a0b66114d 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:27:49 devstack quobyte-client[83193]: System call of process 84685 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:27:49 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=3, name=volume-74cf6b74-0ac1-4d0d-9958-650a0b66114d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:27:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-3cbb9d06-007c-4b9b-93ab-968e2242a04d tempest-AttachVolumeTestJSON-1453990575 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-74cf6b74-0ac1-4d0d-9958-650a0b66114d 1073741824" returned: 0 in 0.869s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:27:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-3cbb9d06-007c-4b9b-93ab-968e2242a04d tempest-AttachVolumeTestJSON-1453990575 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-74cf6b74-0ac1-4d0d-9958-650a0b66114d {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:27:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-3cbb9d06-007c-4b9b-93ab-968e2242a04d tempest-AttachVolumeTestJSON-1453990575 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-74cf6b74-0ac1-4d0d-9958-650a0b66114d" returned: 0 in 0.223s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:27:50 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-3cbb9d06-007c-4b9b-93ab-968e2242a04d tempest-AttachVolumeTestJSON-1453990575 None] <== create_volume: return (1196ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:27:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-3cbb9d06-007c-4b9b-93ab-968e2242a04d tempest-AttachVolumeTestJSON-1453990575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:27:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3cbb9d06-007c-4b9b-93ab-968e2242a04d tempest-AttachVolumeTestJSON-1453990575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c83f36-7efd-44c2-9cd6-f2023b253d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74cf6b74-0ac1-4d0d-9958-650a0b66114d', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:27:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3cbb9d06-007c-4b9b-93ab-968e2242a04d tempest-AttachVolumeTestJSON-1453990575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b20e937a-a5ac-41d1-9472-b5a9e71a82da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:27:50 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-dab67845-b803-417a-a9e4-85685097292b tempest-AttachSCSIVolumeTestJSON-215313680 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:27:50 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-dab67845-b803-417a-a9e4-85685097292b tempest-AttachSCSIVolumeTestJSON-215313680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:27:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-dab67845-b803-417a-a9e4-85685097292b tempest-AttachSCSIVolumeTestJSON-215313680 None] Flow 'volume_create_manager' (9d8d8617-0116-40b6-9836-ca880ce06e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:27:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-dab67845-b803-417a-a9e4-85685097292b tempest-AttachSCSIVolumeTestJSON-215313680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ef05a67-c12f-4f43-a669-7ca551de9aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:27:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-dab67845-b803-417a-a9e4-85685097292b tempest-AttachSCSIVolumeTestJSON-215313680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ef05a67-c12f-4f43-a669-7ca551de9aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1707165102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dcdde63-4e26-4ecc-915f-7b7a95faa46a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e972981784b84319b81525b771dfdf95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:27:50Z,use_quota=True,user_id='f066429e3f5e448c838a6acf990c4a87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:27:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-dab67845-b803-417a-a9e4-85685097292b tempest-AttachSCSIVolumeTestJSON-215313680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e094e8e0-4e30-4294-a727-08e734c2be57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:27:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-dab67845-b803-417a-a9e4-85685097292b tempest-AttachSCSIVolumeTestJSON-215313680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e094e8e0-4e30-4294-a727-08e734c2be57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:27:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-dab67845-b803-417a-a9e4-85685097292b tempest-AttachSCSIVolumeTestJSON-215313680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fa0a545-ea09-49af-ab47-d0d252b1ea5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:27:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-dab67845-b803-417a-a9e4-85685097292b tempest-AttachSCSIVolumeTestJSON-215313680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fa0a545-ea09-49af-ab47-d0d252b1ea5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dcdde63-4e26-4ecc-915f-7b7a95faa46a', 'volume_name': 'volume-2dcdde63-4e26-4ecc-915f-7b7a95faa46a', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:27:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-dab67845-b803-417a-a9e4-85685097292b tempest-AttachSCSIVolumeTestJSON-215313680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17c25c57-aa4d-4071-9722-2825f60f44d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:27:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-dab67845-b803-417a-a9e4-85685097292b tempest-AttachSCSIVolumeTestJSON-215313680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17c25c57-aa4d-4071-9722-2825f60f44d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:27:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-dab67845-b803-417a-a9e4-85685097292b tempest-AttachSCSIVolumeTestJSON-215313680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd2d0454-b8da-41b3-baec-a49bd2efe673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:27:50 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-dab67845-b803-417a-a9e4-85685097292b tempest-AttachSCSIVolumeTestJSON-215313680 None] Volume 2dcdde63-4e26-4ecc-915f-7b7a95faa46a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dcdde63-4e26-4ecc-915f-7b7a95faa46a', 'volume_size': 1}
Sep 18 11:27:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-dab67845-b803-417a-a9e4-85685097292b tempest-AttachSCSIVolumeTestJSON-215313680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:27:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-dab67845-b803-417a-a9e4-85685097292b tempest-AttachSCSIVolumeTestJSON-215313680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:27:50 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-dab67845-b803-417a-a9e4-85685097292b tempest-AttachSCSIVolumeTestJSON-215313680 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1707165102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dcdde63-4e26-4ecc-915f-7b7a95faa46a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e972981784b84319b81525b771dfdf95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:27:50Z,use_quota=True,user_id='f066429e3f5e448c838a6acf990c4a87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:27:50 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-dab67845-b803-417a-a9e4-85685097292b tempest-AttachSCSIVolumeTestJSON-215313680 None] Creating volume 2dcdde63-4e26-4ecc-915f-7b7a95faa46a {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:27:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-dab67845-b803-417a-a9e4-85685097292b tempest-AttachSCSIVolumeTestJSON-215313680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:27:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-dab67845-b803-417a-a9e4-85685097292b tempest-AttachSCSIVolumeTestJSON-215313680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:27:50 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-dab67845-b803-417a-a9e4-85685097292b tempest-AttachSCSIVolumeTestJSON-215313680 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:27:50 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-dab67845-b803-417a-a9e4-85685097292b tempest-AttachSCSIVolumeTestJSON-215313680 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:27:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-dab67845-b803-417a-a9e4-85685097292b tempest-AttachSCSIVolumeTestJSON-215313680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:27:50 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-dab67845-b803-417a-a9e4-85685097292b tempest-AttachSCSIVolumeTestJSON-215313680 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:27:50 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-dab67845-b803-417a-a9e4-85685097292b tempest-AttachSCSIVolumeTestJSON-215313680 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:27:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-dab67845-b803-417a-a9e4-85685097292b tempest-AttachSCSIVolumeTestJSON-215313680 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2dcdde63-4e26-4ecc-915f-7b7a95faa46a 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:27:50 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-3cbb9d06-007c-4b9b-93ab-968e2242a04d tempest-AttachVolumeTestJSON-1453990575 None] Volume volume-74cf6b74-0ac1-4d0d-9958-650a0b66114d (74cf6b74-0ac1-4d0d-9958-650a0b66114d): created successfully
Sep 18 11:27:50 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=4, name=volume-2dcdde63-4e26-4ecc-915f-7b7a95faa46a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:27:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3cbb9d06-007c-4b9b-93ab-968e2242a04d tempest-AttachVolumeTestJSON-1453990575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b20e937a-a5ac-41d1-9472-b5a9e71a82da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:27:51 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3cbb9d06-007c-4b9b-93ab-968e2242a04d tempest-AttachVolumeTestJSON-1453990575 None] Flow 'volume_create_manager' (c1e491d5-31b1-41bc-ab37-f93907419dc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:27:51 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-3cbb9d06-007c-4b9b-93ab-968e2242a04d tempest-AttachVolumeTestJSON-1453990575 None] Created volume successfully.
Sep 18 11:27:51 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-dab67845-b803-417a-a9e4-85685097292b tempest-AttachSCSIVolumeTestJSON-215313680 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2dcdde63-4e26-4ecc-915f-7b7a95faa46a 1073741824" returned: 0 in 0.807s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:27:51 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-dab67845-b803-417a-a9e4-85685097292b tempest-AttachSCSIVolumeTestJSON-215313680 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2dcdde63-4e26-4ecc-915f-7b7a95faa46a {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:27:51 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-dab67845-b803-417a-a9e4-85685097292b tempest-AttachSCSIVolumeTestJSON-215313680 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2dcdde63-4e26-4ecc-915f-7b7a95faa46a" returned: 0 in 0.153s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:27:51 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-dab67845-b803-417a-a9e4-85685097292b tempest-AttachSCSIVolumeTestJSON-215313680 None] <== create_volume: return (1041ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:27:51 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-dab67845-b803-417a-a9e4-85685097292b tempest-AttachSCSIVolumeTestJSON-215313680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:27:51 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-dab67845-b803-417a-a9e4-85685097292b tempest-AttachSCSIVolumeTestJSON-215313680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd2d0454-b8da-41b3-baec-a49bd2efe673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dcdde63-4e26-4ecc-915f-7b7a95faa46a', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:27:51 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-dab67845-b803-417a-a9e4-85685097292b tempest-AttachSCSIVolumeTestJSON-215313680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b95a03c2-b9b1-4721-a057-8649f1d1351e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:27:51 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-dab67845-b803-417a-a9e4-85685097292b tempest-AttachSCSIVolumeTestJSON-215313680 None] Volume volume-2dcdde63-4e26-4ecc-915f-7b7a95faa46a (2dcdde63-4e26-4ecc-915f-7b7a95faa46a): created successfully
Sep 18 11:27:51 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-dab67845-b803-417a-a9e4-85685097292b tempest-AttachSCSIVolumeTestJSON-215313680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b95a03c2-b9b1-4721-a057-8649f1d1351e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:27:52 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-dab67845-b803-417a-a9e4-85685097292b tempest-AttachSCSIVolumeTestJSON-215313680 None] Flow 'volume_create_manager' (9d8d8617-0116-40b6-9836-ca880ce06e34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:27:52 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-dab67845-b803-417a-a9e4-85685097292b tempest-AttachSCSIVolumeTestJSON-215313680 None] Created volume successfully.
Sep 18 11:28:01 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:28:02 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1,cinder:DELETE=2 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:28:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-32ffce77-c1ef-4fe7-ba51-e2a94ceb43a9 req-e9b0778b-3299-44d7-8549-62df8b7985a4 tempest-AttachVolumeTestJSON-1453990575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:28:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-32ffce77-c1ef-4fe7-ba51-e2a94ceb43a9 req-e9b0778b-3299-44d7-8549-62df8b7985a4 tempest-AttachVolumeTestJSON-1453990575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:28:02 devstack cinder-volume[83176]: INFO oslo.privsep.daemon [req-32ffce77-c1ef-4fe7-ba51-e2a94ceb43a9 req-e9b0778b-3299-44d7-8549-62df8b7985a4 tempest-AttachVolumeTestJSON-1453990575 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpq1yztet_/privsep.sock']
Sep 18 11:28:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-c8150e00-66b1-4dfc-b42f-b3bc8c0a9b36 req-030c8693-2257-4b1c-86ea-e6b935869598 tempest-AttachSCSIVolumeTestJSON-215313680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:28:02 devstack sudo[84770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpq1yztet_/privsep.sock
Sep 18 11:28:02 devstack sudo[84770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:28:07 devstack sudo[84770]: pam_unix(sudo:session): session closed for user root
Sep 18 11:28:07 devstack cinder-volume[83176]: INFO oslo.privsep.daemon [req-32ffce77-c1ef-4fe7-ba51-e2a94ceb43a9 req-e9b0778b-3299-44d7-8549-62df8b7985a4 tempest-AttachVolumeTestJSON-1453990575 None] Spawned new privsep daemon via rootwrap
Sep 18 11:28:07 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [req-32ffce77-c1ef-4fe7-ba51-e2a94ceb43a9 req-e9b0778b-3299-44d7-8549-62df8b7985a4 tempest-AttachVolumeTestJSON-1453990575 None] Accepted privsep connection to /tmp/tmpq1yztet_/privsep.sock {{(pid=83176) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:377}}
Sep 18 11:28:07 devstack cinder-volume[83176]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 18 11:28:07 devstack cinder-volume[83176]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 18 11:28:07 devstack cinder-volume[83176]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 18 11:28:07 devstack cinder-volume[83176]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84776
Sep 18 11:28:07 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5312ca-b9ad-46a8-8831-bdd7e965d650]: (2,) {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:28:08 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b9c6f8-bc01-4736-97b1-607ab197287e]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:28:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-32ffce77-c1ef-4fe7-ba51-e2a94ceb43a9 req-e9b0778b-3299-44d7-8549-62df8b7985a4 tempest-AttachVolumeTestJSON-1453990575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-74cf6b74-0ac1-4d0d-9958-650a0b66114d {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:28:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-32ffce77-c1ef-4fe7-ba51-e2a94ceb43a9 req-e9b0778b-3299-44d7-8549-62df8b7985a4 tempest-AttachVolumeTestJSON-1453990575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-74cf6b74-0ac1-4d0d-9958-650a0b66114d" returned: 0 in 0.484s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:28:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-32ffce77-c1ef-4fe7-ba51-e2a94ceb43a9 req-e9b0778b-3299-44d7-8549-62df8b7985a4 tempest-AttachVolumeTestJSON-1453990575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 5.766s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:28:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-c8150e00-66b1-4dfc-b42f-b3bc8c0a9b36 req-030c8693-2257-4b1c-86ea-e6b935869598 tempest-AttachSCSIVolumeTestJSON-215313680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.930s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:28:08 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3ca518-7a3f-4f20-960d-f3c0980849fc]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:28:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-c8150e00-66b1-4dfc-b42f-b3bc8c0a9b36 req-030c8693-2257-4b1c-86ea-e6b935869598 tempest-AttachSCSIVolumeTestJSON-215313680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2dcdde63-4e26-4ecc-915f-7b7a95faa46a {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:28:09 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-32ffce77-c1ef-4fe7-ba51-e2a94ceb43a9 req-e9b0778b-3299-44d7-8549-62df8b7985a4 tempest-AttachVolumeTestJSON-1453990575 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8', 'name': 'volume-74cf6b74-0ac1-4d0d-9958-650a0b66114d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '33ddc640-70a1-47b4-9c4b-0e6a377e022d', 'enforce_multipath': True} {{(pid=83176) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 11:28:09 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-32ffce77-c1ef-4fe7-ba51-e2a94ceb43a9 req-e9b0778b-3299-44d7-8549-62df8b7985a4 tempest-AttachVolumeTestJSON-1453990575 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:28:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-c8150e00-66b1-4dfc-b42f-b3bc8c0a9b36 req-030c8693-2257-4b1c-86ea-e6b935869598 tempest-AttachSCSIVolumeTestJSON-215313680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2dcdde63-4e26-4ecc-915f-7b7a95faa46a" returned: 0 in 1.056s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:28:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-c8150e00-66b1-4dfc-b42f-b3bc8c0a9b36 req-030c8693-2257-4b1c-86ea-e6b935869598 tempest-AttachSCSIVolumeTestJSON-215313680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.138s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:28:09 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-32ffce77-c1ef-4fe7-ba51-e2a94ceb43a9 req-e9b0778b-3299-44d7-8549-62df8b7985a4 tempest-AttachVolumeTestJSON-1453990575 None] attachment_update completed successfully.
Sep 18 11:28:10 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-c8150e00-66b1-4dfc-b42f-b3bc8c0a9b36 req-030c8693-2257-4b1c-86ea-e6b935869598 tempest-AttachSCSIVolumeTestJSON-215313680 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8', 'name': 'volume-2dcdde63-4e26-4ecc-915f-7b7a95faa46a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '953f3c81-4474-40f3-a016-a424ef8abcc3', 'enforce_multipath': True} {{(pid=83176) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 11:28:10 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-c8150e00-66b1-4dfc-b42f-b3bc8c0a9b36 req-030c8693-2257-4b1c-86ea-e6b935869598 tempest-AttachSCSIVolumeTestJSON-215313680 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:28:10 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-c8150e00-66b1-4dfc-b42f-b3bc8c0a9b36 req-030c8693-2257-4b1c-86ea-e6b935869598 tempest-AttachSCSIVolumeTestJSON-215313680 None] attachment_update completed successfully.
Sep 18 11:28:13 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 11:28:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:28:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:28:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:28:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:28:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:28:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:28:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.123s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:28:13 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:28:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-8055b30e-af19-4ab5-96db-23dc8e7d7060 req-8058a146-a86b-4a77-b458-aff13e09cb19 tempest-VolumesAssistedSnapshotsTest-1430508158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:28:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-8055b30e-af19-4ab5-96db-23dc8e7d7060 req-8058a146-a86b-4a77-b458-aff13e09cb19 tempest-VolumesAssistedSnapshotsTest-1430508158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:28:14 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2e2ef7-78bb-4a52-9680-e70d3373d4ca]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:28:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-8055b30e-af19-4ab5-96db-23dc8e7d7060 req-8058a146-a86b-4a77-b458-aff13e09cb19 tempest-VolumesAssistedSnapshotsTest-1430508158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-fb219d6a-d345-4b0f-85ce-2205e89595c9 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:28:14 devstack quobyte-client[83193]: System call of process 85197 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:28:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-8055b30e-af19-4ab5-96db-23dc8e7d7060 req-8058a146-a86b-4a77-b458-aff13e09cb19 tempest-VolumesAssistedSnapshotsTest-1430508158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-fb219d6a-d345-4b0f-85ce-2205e89595c9" returned: 0 in 0.547s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:28:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-8055b30e-af19-4ab5-96db-23dc8e7d7060 req-8058a146-a86b-4a77-b458-aff13e09cb19 tempest-VolumesAssistedSnapshotsTest-1430508158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.624s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:28:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-8055b30e-af19-4ab5-96db-23dc8e7d7060 req-8058a146-a86b-4a77-b458-aff13e09cb19 tempest-VolumesAssistedSnapshotsTest-1430508158 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8', 'name': 'volume-fb219d6a-d345-4b0f-85ce-2205e89595c9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aee40d6e-7bc9-4aef-a1df-33753fb6c6c2', 'enforce_multipath': True} {{(pid=83176) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 11:28:15 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-8055b30e-af19-4ab5-96db-23dc8e7d7060 req-8058a146-a86b-4a77-b458-aff13e09cb19 tempest-VolumesAssistedSnapshotsTest-1430508158 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:28:15 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-8055b30e-af19-4ab5-96db-23dc8e7d7060 req-8058a146-a86b-4a77-b458-aff13e09cb19 tempest-VolumesAssistedSnapshotsTest-1430508158 None] attachment_update completed successfully.
Sep 18 11:28:25 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=17,cinder:UPDATE=4 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:28:25 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=16,cinder:UPDATE=5 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:28:43 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:28:43 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:UPDATE=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:28:44 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-1b1104fb-b10c-403d-bb69-78d65f3eee85 req-30ce4018-afe3-4674-8043-13a8a44916ab tempest-AttachSCSIVolumeTestJSON-215313680 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:28:44 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-1b1104fb-b10c-403d-bb69-78d65f3eee85 req-30ce4018-afe3-4674-8043-13a8a44916ab tempest-AttachSCSIVolumeTestJSON-215313680 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:28:44 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-1b1104fb-b10c-403d-bb69-78d65f3eee85 req-30ce4018-afe3-4674-8043-13a8a44916ab tempest-AttachSCSIVolumeTestJSON-215313680 None] Terminate volume connection completed successfully.
Sep 18 11:28:44 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-1b1104fb-b10c-403d-bb69-78d65f3eee85 req-30ce4018-afe3-4674-8043-13a8a44916ab tempest-AttachSCSIVolumeTestJSON-215313680 None] Deleting attachment 953f3c81-4474-40f3-a016-a424ef8abcc3. {{(pid=83176) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 11:28:46 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-f6a6c338-88ff-40dc-8f2b-41ecd8bc709e req-a916287a-16a1-49f5-bf2e-3aa25c81009f tempest-VolumesAssistedSnapshotsTest-1430508158 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:28:46 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-f6a6c338-88ff-40dc-8f2b-41ecd8bc709e req-a916287a-16a1-49f5-bf2e-3aa25c81009f tempest-VolumesAssistedSnapshotsTest-1430508158 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:28:46 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-f6a6c338-88ff-40dc-8f2b-41ecd8bc709e req-a916287a-16a1-49f5-bf2e-3aa25c81009f tempest-VolumesAssistedSnapshotsTest-1430508158 None] Terminate volume connection completed successfully.
Sep 18 11:28:46 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-f6a6c338-88ff-40dc-8f2b-41ecd8bc709e req-a916287a-16a1-49f5-bf2e-3aa25c81009f tempest-VolumesAssistedSnapshotsTest-1430508158 None] Deleting attachment aee40d6e-7bc9-4aef-a1df-33753fb6c6c2. {{(pid=83176) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 11:28:48 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-a7f1c32e-2821-42ee-b6a5-9d94f5f7c9a1 tempest-VolumesAssistedSnapshotsTest-1430508158 None] Acquiring lock "cinder-fb219d6a-d345-4b0f-85ce-2205e89595c9-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:28:48 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-a7f1c32e-2821-42ee-b6a5-9d94f5f7c9a1 tempest-VolumesAssistedSnapshotsTest-1430508158 None] Lock "cinder-fb219d6a-d345-4b0f-85ce-2205e89595c9-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:28:48 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-a7f1c32e-2821-42ee-b6a5-9d94f5f7c9a1 tempest-VolumesAssistedSnapshotsTest-1430508158 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:28:48 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-a7f1c32e-2821-42ee-b6a5-9d94f5f7c9a1 tempest-VolumesAssistedSnapshotsTest-1430508158 None] Acquiring lock "cinder-quobyte-fb219d6a-d345-4b0f-85ce-2205e89595c9" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:28:48 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-a7f1c32e-2821-42ee-b6a5-9d94f5f7c9a1 tempest-VolumesAssistedSnapshotsTest-1430508158 None] Lock "cinder-quobyte-fb219d6a-d345-4b0f-85ce-2205e89595c9" acquired by "delete_volume" :: waited 0.080s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:28:48 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d4838e-7fa2-4dc0-9032-c977ebd77505]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:28:48 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a7f1c32e-2821-42ee-b6a5-9d94f5f7c9a1 tempest-VolumesAssistedSnapshotsTest-1430508158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-fb219d6a-d345-4b0f-85ce-2205e89595c9 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:28:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a7f1c32e-2821-42ee-b6a5-9d94f5f7c9a1 tempest-VolumesAssistedSnapshotsTest-1430508158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-fb219d6a-d345-4b0f-85ce-2205e89595c9" returned: 0 in 1.341s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:28:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a7f1c32e-2821-42ee-b6a5-9d94f5f7c9a1 tempest-VolumesAssistedSnapshotsTest-1430508158 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-fb219d6a-d345-4b0f-85ce-2205e89595c9 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:28:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a7f1c32e-2821-42ee-b6a5-9d94f5f7c9a1 tempest-VolumesAssistedSnapshotsTest-1430508158 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-fb219d6a-d345-4b0f-85ce-2205e89595c9" returned: 0 in 0.153s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:28:50 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-a7f1c32e-2821-42ee-b6a5-9d94f5f7c9a1 tempest-VolumesAssistedSnapshotsTest-1430508158 None] Lock "cinder-quobyte-fb219d6a-d345-4b0f-85ce-2205e89595c9" released by "delete_volume" :: held 1.962s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:28:50 devstack cinder-volume[83176]: WARNING cinder.quota [None req-a7f1c32e-2821-42ee-b6a5-9d94f5f7c9a1 tempest-VolumesAssistedSnapshotsTest-1430508158 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 18 11:28:50 devstack cinder-volume[83176]: WARNING cinder.quota [None req-a7f1c32e-2821-42ee-b6a5-9d94f5f7c9a1 tempest-VolumesAssistedSnapshotsTest-1430508158 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 18 11:28:50 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-a7f1c32e-2821-42ee-b6a5-9d94f5f7c9a1 tempest-VolumesAssistedSnapshotsTest-1430508158 None] Created reservations ['296f73c9-c7f7-47d8-a2ee-512b34515664', '0c9e983a-32ce-4d64-9424-19010a6b4ca7', '2f19a055-8337-49ca-8183-8d726e5325b1', '49820c59-b312-4646-97a4-a6fee9d77a4d'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:28:51 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a7f1c32e-2821-42ee-b6a5-9d94f5f7c9a1 tempest-VolumesAssistedSnapshotsTest-1430508158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:28:51 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a7f1c32e-2821-42ee-b6a5-9d94f5f7c9a1 tempest-VolumesAssistedSnapshotsTest-1430508158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:28:51 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a7f1c32e-2821-42ee-b6a5-9d94f5f7c9a1 tempest-VolumesAssistedSnapshotsTest-1430508158 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:28:51 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a7f1c32e-2821-42ee-b6a5-9d94f5f7c9a1 tempest-VolumesAssistedSnapshotsTest-1430508158 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:28:51 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a7f1c32e-2821-42ee-b6a5-9d94f5f7c9a1 tempest-VolumesAssistedSnapshotsTest-1430508158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:28:51 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a7f1c32e-2821-42ee-b6a5-9d94f5f7c9a1 tempest-VolumesAssistedSnapshotsTest-1430508158 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:28:51 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a7f1c32e-2821-42ee-b6a5-9d94f5f7c9a1 tempest-VolumesAssistedSnapshotsTest-1430508158 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.126s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:28:51 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a7f1c32e-2821-42ee-b6a5-9d94f5f7c9a1 tempest-VolumesAssistedSnapshotsTest-1430508158 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:28:51 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-a7f1c32e-2821-42ee-b6a5-9d94f5f7c9a1 tempest-VolumesAssistedSnapshotsTest-1430508158 None] Deleted volume successfully.
Sep 18 11:28:51 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-a7f1c32e-2821-42ee-b6a5-9d94f5f7c9a1 tempest-VolumesAssistedSnapshotsTest-1430508158 None] Lock "cinder-fb219d6a-d345-4b0f-85ce-2205e89595c9-delete_volume" released by "delete_volume" :: held 3.561s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:29:01 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=5,cinder:UPDATE=8,cinder:INSERT=2 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:29:01 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=9,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:29:02 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f0d7779f-5c34-4d4a-87da-12d06eb70752 tempest-AttachSCSIVolumeTestJSON-215313680 None] Acquiring lock "cinder-2dcdde63-4e26-4ecc-915f-7b7a95faa46a-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:29:02 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f0d7779f-5c34-4d4a-87da-12d06eb70752 tempest-AttachSCSIVolumeTestJSON-215313680 None] Lock "cinder-2dcdde63-4e26-4ecc-915f-7b7a95faa46a-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:29:02 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-f0d7779f-5c34-4d4a-87da-12d06eb70752 tempest-AttachSCSIVolumeTestJSON-215313680 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:29:02 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f0d7779f-5c34-4d4a-87da-12d06eb70752 tempest-AttachSCSIVolumeTestJSON-215313680 None] Acquiring lock "cinder-quobyte-2dcdde63-4e26-4ecc-915f-7b7a95faa46a" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:29:02 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f0d7779f-5c34-4d4a-87da-12d06eb70752 tempest-AttachSCSIVolumeTestJSON-215313680 None] Lock "cinder-quobyte-2dcdde63-4e26-4ecc-915f-7b7a95faa46a" acquired by "delete_volume" :: waited 0.043s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:29:02 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e1e0bd-3c9f-4c25-8457-88bdaa6ebec4]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:29:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f0d7779f-5c34-4d4a-87da-12d06eb70752 tempest-AttachSCSIVolumeTestJSON-215313680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2dcdde63-4e26-4ecc-915f-7b7a95faa46a {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:29:03 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f0d7779f-5c34-4d4a-87da-12d06eb70752 tempest-AttachSCSIVolumeTestJSON-215313680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2dcdde63-4e26-4ecc-915f-7b7a95faa46a" returned: 0 in 0.594s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:29:03 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f0d7779f-5c34-4d4a-87da-12d06eb70752 tempest-AttachSCSIVolumeTestJSON-215313680 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2dcdde63-4e26-4ecc-915f-7b7a95faa46a {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:29:03 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f0d7779f-5c34-4d4a-87da-12d06eb70752 tempest-AttachSCSIVolumeTestJSON-215313680 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2dcdde63-4e26-4ecc-915f-7b7a95faa46a" returned: 0 in 0.116s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:29:03 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f0d7779f-5c34-4d4a-87da-12d06eb70752 tempest-AttachSCSIVolumeTestJSON-215313680 None] Lock "cinder-quobyte-2dcdde63-4e26-4ecc-915f-7b7a95faa46a" released by "delete_volume" :: held 0.933s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:29:03 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-f0d7779f-5c34-4d4a-87da-12d06eb70752 tempest-AttachSCSIVolumeTestJSON-215313680 None] Created reservations ['fed35a8a-4a6d-4ec9-9ab4-3003c602077f', 'c6c25db7-103e-4ccb-9178-27670a9961f3', '756cac3c-c66c-48ce-8726-d270eab919d8', '760185fc-0356-4341-a934-02a4c987eeff'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:29:03 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f0d7779f-5c34-4d4a-87da-12d06eb70752 tempest-AttachSCSIVolumeTestJSON-215313680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:29:03 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f0d7779f-5c34-4d4a-87da-12d06eb70752 tempest-AttachSCSIVolumeTestJSON-215313680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.024s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:29:03 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f0d7779f-5c34-4d4a-87da-12d06eb70752 tempest-AttachSCSIVolumeTestJSON-215313680 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:29:03 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f0d7779f-5c34-4d4a-87da-12d06eb70752 tempest-AttachSCSIVolumeTestJSON-215313680 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:29:03 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f0d7779f-5c34-4d4a-87da-12d06eb70752 tempest-AttachSCSIVolumeTestJSON-215313680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:29:03 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f0d7779f-5c34-4d4a-87da-12d06eb70752 tempest-AttachSCSIVolumeTestJSON-215313680 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:29:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f0d7779f-5c34-4d4a-87da-12d06eb70752 tempest-AttachSCSIVolumeTestJSON-215313680 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.152s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:29:04 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-f0d7779f-5c34-4d4a-87da-12d06eb70752 tempest-AttachSCSIVolumeTestJSON-215313680 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:29:04 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-f0d7779f-5c34-4d4a-87da-12d06eb70752 tempest-AttachSCSIVolumeTestJSON-215313680 None] Deleted volume successfully.
Sep 18 11:29:04 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f0d7779f-5c34-4d4a-87da-12d06eb70752 tempest-AttachSCSIVolumeTestJSON-215313680 None] Lock "cinder-2dcdde63-4e26-4ecc-915f-7b7a95faa46a-delete_volume" released by "delete_volume" :: held 2.217s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:29:13 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 11:29:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:29:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:29:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:29:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:29:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.083s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:29:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:29:14 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=8,cinder:UPDATE=12 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:29:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.427s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:29:14 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:29:14 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2,cinder:INSERT=4,cinder:DELETE=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:30:12 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-2fdeec4f-5a4f-4e82-8259-21b8c7fa6059 req-03bb6f24-7873-4b40-a0a3-84817944fe29 tempest-AttachVolumeTestJSON-1453990575 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:30:12 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-2fdeec4f-5a4f-4e82-8259-21b8c7fa6059 req-03bb6f24-7873-4b40-a0a3-84817944fe29 tempest-AttachVolumeTestJSON-1453990575 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:30:12 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-2fdeec4f-5a4f-4e82-8259-21b8c7fa6059 req-03bb6f24-7873-4b40-a0a3-84817944fe29 tempest-AttachVolumeTestJSON-1453990575 None] Terminate volume connection completed successfully.
Sep 18 11:30:12 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-2fdeec4f-5a4f-4e82-8259-21b8c7fa6059 req-03bb6f24-7873-4b40-a0a3-84817944fe29 tempest-AttachVolumeTestJSON-1453990575 None] Deleting attachment 33ddc640-70a1-47b4-9c4b-0e6a377e022d. {{(pid=83176) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 11:30:13 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 11:30:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:30:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.021s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:30:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:30:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:30:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.085s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:30:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:30:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.313s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:30:14 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:30:21 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-1619dd2d-b5a5-48d4-a0f9-ef583ad264a2 tempest-DeleteServersTestJSON-1645773089 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:30:21 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-1619dd2d-b5a5-48d4-a0f9-ef583ad264a2 tempest-DeleteServersTestJSON-1645773089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:30:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1619dd2d-b5a5-48d4-a0f9-ef583ad264a2 tempest-DeleteServersTestJSON-1645773089 None] Flow 'volume_create_manager' (051a87a9-f42a-403a-b373-6cb4d62fc86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:30:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1619dd2d-b5a5-48d4-a0f9-ef583ad264a2 tempest-DeleteServersTestJSON-1645773089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a3216de-3e54-4997-97c7-69afaf233f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:30:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1619dd2d-b5a5-48d4-a0f9-ef583ad264a2 tempest-DeleteServersTestJSON-1645773089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a3216de-3e54-4997-97c7-69afaf233f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1548592435',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c5e3301-b909-47c3-b7ae-4168ef7112ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a2d3fb512e4491ae400a90bdf20883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:30:21Z,use_quota=True,user_id='5ce60a99aa1c41698bf8d70f788989c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:30:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1619dd2d-b5a5-48d4-a0f9-ef583ad264a2 tempest-DeleteServersTestJSON-1645773089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b97489e5-c68b-4098-b896-ef2319b7661d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:30:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1619dd2d-b5a5-48d4-a0f9-ef583ad264a2 tempest-DeleteServersTestJSON-1645773089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b97489e5-c68b-4098-b896-ef2319b7661d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:30:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1619dd2d-b5a5-48d4-a0f9-ef583ad264a2 tempest-DeleteServersTestJSON-1645773089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53cf15d8-df77-4760-be21-6ac1c44b64a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:30:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1619dd2d-b5a5-48d4-a0f9-ef583ad264a2 tempest-DeleteServersTestJSON-1645773089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53cf15d8-df77-4760-be21-6ac1c44b64a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c5e3301-b909-47c3-b7ae-4168ef7112ca', 'volume_name': 'volume-4c5e3301-b909-47c3-b7ae-4168ef7112ca', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:30:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1619dd2d-b5a5-48d4-a0f9-ef583ad264a2 tempest-DeleteServersTestJSON-1645773089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (840422ec-b4ed-49c8-91d6-7e8d099b827c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:30:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1619dd2d-b5a5-48d4-a0f9-ef583ad264a2 tempest-DeleteServersTestJSON-1645773089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (840422ec-b4ed-49c8-91d6-7e8d099b827c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:30:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1619dd2d-b5a5-48d4-a0f9-ef583ad264a2 tempest-DeleteServersTestJSON-1645773089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07582fbb-55c5-447e-aead-e9d9ae2b9b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:30:21 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-1619dd2d-b5a5-48d4-a0f9-ef583ad264a2 tempest-DeleteServersTestJSON-1645773089 None] Volume 4c5e3301-b909-47c3-b7ae-4168ef7112ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c5e3301-b909-47c3-b7ae-4168ef7112ca', 'volume_size': 1}
Sep 18 11:30:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1619dd2d-b5a5-48d4-a0f9-ef583ad264a2 tempest-DeleteServersTestJSON-1645773089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:30:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1619dd2d-b5a5-48d4-a0f9-ef583ad264a2 tempest-DeleteServersTestJSON-1645773089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:30:21 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-1619dd2d-b5a5-48d4-a0f9-ef583ad264a2 tempest-DeleteServersTestJSON-1645773089 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1548592435',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c5e3301-b909-47c3-b7ae-4168ef7112ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a2d3fb512e4491ae400a90bdf20883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:30:21Z,use_quota=True,user_id='5ce60a99aa1c41698bf8d70f788989c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:30:21 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-1619dd2d-b5a5-48d4-a0f9-ef583ad264a2 tempest-DeleteServersTestJSON-1645773089 None] Creating volume 4c5e3301-b909-47c3-b7ae-4168ef7112ca {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:30:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1619dd2d-b5a5-48d4-a0f9-ef583ad264a2 tempest-DeleteServersTestJSON-1645773089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:30:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1619dd2d-b5a5-48d4-a0f9-ef583ad264a2 tempest-DeleteServersTestJSON-1645773089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:30:21 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-1619dd2d-b5a5-48d4-a0f9-ef583ad264a2 tempest-DeleteServersTestJSON-1645773089 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:30:21 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-1619dd2d-b5a5-48d4-a0f9-ef583ad264a2 tempest-DeleteServersTestJSON-1645773089 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:30:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1619dd2d-b5a5-48d4-a0f9-ef583ad264a2 tempest-DeleteServersTestJSON-1645773089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:30:21 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-1619dd2d-b5a5-48d4-a0f9-ef583ad264a2 tempest-DeleteServersTestJSON-1645773089 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:30:21 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-1619dd2d-b5a5-48d4-a0f9-ef583ad264a2 tempest-DeleteServersTestJSON-1645773089 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:30:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1619dd2d-b5a5-48d4-a0f9-ef583ad264a2 tempest-DeleteServersTestJSON-1645773089 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4c5e3301-b909-47c3-b7ae-4168ef7112ca 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:30:21 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=5, name=volume-4c5e3301-b909-47c3-b7ae-4168ef7112ca, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:30:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1619dd2d-b5a5-48d4-a0f9-ef583ad264a2 tempest-DeleteServersTestJSON-1645773089 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4c5e3301-b909-47c3-b7ae-4168ef7112ca 1073741824" returned: 0 in 0.723s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:30:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1619dd2d-b5a5-48d4-a0f9-ef583ad264a2 tempest-DeleteServersTestJSON-1645773089 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4c5e3301-b909-47c3-b7ae-4168ef7112ca {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:30:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1619dd2d-b5a5-48d4-a0f9-ef583ad264a2 tempest-DeleteServersTestJSON-1645773089 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4c5e3301-b909-47c3-b7ae-4168ef7112ca" returned: 0 in 0.385s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:30:22 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-1619dd2d-b5a5-48d4-a0f9-ef583ad264a2 tempest-DeleteServersTestJSON-1645773089 None] <== create_volume: return (1304ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:30:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1619dd2d-b5a5-48d4-a0f9-ef583ad264a2 tempest-DeleteServersTestJSON-1645773089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.343s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:30:23 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1619dd2d-b5a5-48d4-a0f9-ef583ad264a2 tempest-DeleteServersTestJSON-1645773089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07582fbb-55c5-447e-aead-e9d9ae2b9b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c5e3301-b909-47c3-b7ae-4168ef7112ca', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:30:23 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1619dd2d-b5a5-48d4-a0f9-ef583ad264a2 tempest-DeleteServersTestJSON-1645773089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c6bdeb3-8e9a-49b6-ba35-90a1ca18c6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:30:23 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-1619dd2d-b5a5-48d4-a0f9-ef583ad264a2 tempest-DeleteServersTestJSON-1645773089 None] Volume volume-4c5e3301-b909-47c3-b7ae-4168ef7112ca (4c5e3301-b909-47c3-b7ae-4168ef7112ca): created successfully
Sep 18 11:30:23 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1619dd2d-b5a5-48d4-a0f9-ef583ad264a2 tempest-DeleteServersTestJSON-1645773089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c6bdeb3-8e9a-49b6-ba35-90a1ca18c6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:30:23 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1619dd2d-b5a5-48d4-a0f9-ef583ad264a2 tempest-DeleteServersTestJSON-1645773089 None] Flow 'volume_create_manager' (051a87a9-f42a-403a-b373-6cb4d62fc86e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:30:23 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-1619dd2d-b5a5-48d4-a0f9-ef583ad264a2 tempest-DeleteServersTestJSON-1645773089 None] Created volume successfully.
Sep 18 11:30:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-dc1c6891-3986-4ba6-a11c-976d891e4d4d req-1fe5503a-aaf6-492a-87d1-d13728a057a1 tempest-DeleteServersTestJSON-1645773089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:30:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-dc1c6891-3986-4ba6-a11c-976d891e4d4d req-1fe5503a-aaf6-492a-87d1-d13728a057a1 tempest-DeleteServersTestJSON-1645773089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.010s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:30:31 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ec00fd-5dc3-4e2b-9806-62f975fc69de]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:30:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-dc1c6891-3986-4ba6-a11c-976d891e4d4d req-1fe5503a-aaf6-492a-87d1-d13728a057a1 tempest-DeleteServersTestJSON-1645773089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4c5e3301-b909-47c3-b7ae-4168ef7112ca {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:30:32 devstack quobyte-client[83193]: System call of process 86239 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:30:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-dc1c6891-3986-4ba6-a11c-976d891e4d4d req-1fe5503a-aaf6-492a-87d1-d13728a057a1 tempest-DeleteServersTestJSON-1645773089 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4c5e3301-b909-47c3-b7ae-4168ef7112ca" returned: 0 in 0.930s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:30:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-dc1c6891-3986-4ba6-a11c-976d891e4d4d req-1fe5503a-aaf6-492a-87d1-d13728a057a1 tempest-DeleteServersTestJSON-1645773089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.084s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:30:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-dc1c6891-3986-4ba6-a11c-976d891e4d4d req-1fe5503a-aaf6-492a-87d1-d13728a057a1 tempest-DeleteServersTestJSON-1645773089 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8', 'name': 'volume-4c5e3301-b909-47c3-b7ae-4168ef7112ca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9fab59d1-81c2-4a77-bc2f-2b0434dc87eb', 'enforce_multipath': True} {{(pid=83176) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 11:30:32 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-dc1c6891-3986-4ba6-a11c-976d891e4d4d req-1fe5503a-aaf6-492a-87d1-d13728a057a1 tempest-DeleteServersTestJSON-1645773089 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:30:33 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-dc1c6891-3986-4ba6-a11c-976d891e4d4d req-1fe5503a-aaf6-492a-87d1-d13728a057a1 tempest-DeleteServersTestJSON-1645773089 None] attachment_update completed successfully.
Sep 18 11:30:43 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=9,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:30:43 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:30:54 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-16c759e9-4199-4e62-b955-88026cfc5984 req-23a4b1ee-6dc1-4552-a0a8-cb077af115f9 tempest-DeleteServersTestJSON-1645773089 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:30:54 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-16c759e9-4199-4e62-b955-88026cfc5984 req-23a4b1ee-6dc1-4552-a0a8-cb077af115f9 tempest-DeleteServersTestJSON-1645773089 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:30:54 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-16c759e9-4199-4e62-b955-88026cfc5984 req-23a4b1ee-6dc1-4552-a0a8-cb077af115f9 tempest-DeleteServersTestJSON-1645773089 None] Terminate volume connection completed successfully.
Sep 18 11:30:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-16c759e9-4199-4e62-b955-88026cfc5984 req-23a4b1ee-6dc1-4552-a0a8-cb077af115f9 tempest-DeleteServersTestJSON-1645773089 None] Deleting attachment 9fab59d1-81c2-4a77-bc2f-2b0434dc87eb. {{(pid=83176) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 11:30:59 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-cf94ea55-0c4f-4944-8f63-b893d3c26e8b tempest-DeleteServersTestJSON-1645773089 None] Acquiring lock "cinder-4c5e3301-b909-47c3-b7ae-4168ef7112ca-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:30:59 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-cf94ea55-0c4f-4944-8f63-b893d3c26e8b tempest-DeleteServersTestJSON-1645773089 None] Lock "cinder-4c5e3301-b909-47c3-b7ae-4168ef7112ca-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:30:59 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-cf94ea55-0c4f-4944-8f63-b893d3c26e8b tempest-DeleteServersTestJSON-1645773089 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:30:59 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-cf94ea55-0c4f-4944-8f63-b893d3c26e8b tempest-DeleteServersTestJSON-1645773089 None] Acquiring lock "cinder-quobyte-4c5e3301-b909-47c3-b7ae-4168ef7112ca" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:30:59 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-cf94ea55-0c4f-4944-8f63-b893d3c26e8b tempest-DeleteServersTestJSON-1645773089 None] Lock "cinder-quobyte-4c5e3301-b909-47c3-b7ae-4168ef7112ca" acquired by "delete_volume" :: waited 0.026s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:30:59 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7da1d5-6b2d-4aa5-99c6-fa1a7251bf73]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:30:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-cf94ea55-0c4f-4944-8f63-b893d3c26e8b tempest-DeleteServersTestJSON-1645773089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4c5e3301-b909-47c3-b7ae-4168ef7112ca {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:30:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-cf94ea55-0c4f-4944-8f63-b893d3c26e8b tempest-DeleteServersTestJSON-1645773089 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4c5e3301-b909-47c3-b7ae-4168ef7112ca" returned: 0 in 0.425s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:30:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-cf94ea55-0c4f-4944-8f63-b893d3c26e8b tempest-DeleteServersTestJSON-1645773089 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4c5e3301-b909-47c3-b7ae-4168ef7112ca {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:30:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-cf94ea55-0c4f-4944-8f63-b893d3c26e8b tempest-DeleteServersTestJSON-1645773089 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4c5e3301-b909-47c3-b7ae-4168ef7112ca" returned: 0 in 0.072s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:30:59 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-cf94ea55-0c4f-4944-8f63-b893d3c26e8b tempest-DeleteServersTestJSON-1645773089 None] Lock "cinder-quobyte-4c5e3301-b909-47c3-b7ae-4168ef7112ca" released by "delete_volume" :: held 0.694s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:31:00 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-cf94ea55-0c4f-4944-8f63-b893d3c26e8b tempest-DeleteServersTestJSON-1645773089 None] Created reservations ['f4fc168a-9b31-45a3-a7cb-96009282c7f3', 'f7989cc5-cac8-43e1-9825-de73ed2cc441', '60889bc2-b5f8-427c-8833-4d744d6a8937', 'bcd575a5-5d68-4b9c-b577-64562689fb05'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:31:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-cf94ea55-0c4f-4944-8f63-b893d3c26e8b tempest-DeleteServersTestJSON-1645773089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:31:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-cf94ea55-0c4f-4944-8f63-b893d3c26e8b tempest-DeleteServersTestJSON-1645773089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.108s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:31:01 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-cf94ea55-0c4f-4944-8f63-b893d3c26e8b tempest-DeleteServersTestJSON-1645773089 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:31:01 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-cf94ea55-0c4f-4944-8f63-b893d3c26e8b tempest-DeleteServersTestJSON-1645773089 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:31:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-cf94ea55-0c4f-4944-8f63-b893d3c26e8b tempest-DeleteServersTestJSON-1645773089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.164s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:31:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-cf94ea55-0c4f-4944-8f63-b893d3c26e8b tempest-DeleteServersTestJSON-1645773089 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:31:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-cf94ea55-0c4f-4944-8f63-b893d3c26e8b tempest-DeleteServersTestJSON-1645773089 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.387s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:31:02 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-cf94ea55-0c4f-4944-8f63-b893d3c26e8b tempest-DeleteServersTestJSON-1645773089 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:31:02 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-cf94ea55-0c4f-4944-8f63-b893d3c26e8b tempest-DeleteServersTestJSON-1645773089 None] Deleted volume successfully.
Sep 18 11:31:03 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-cf94ea55-0c4f-4944-8f63-b893d3c26e8b tempest-DeleteServersTestJSON-1645773089 None] Lock "cinder-4c5e3301-b909-47c3-b7ae-4168ef7112ca-delete_volume" released by "delete_volume" :: held 4.403s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:31:11 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=8,cinder:UPDATE=10,cinder:INSERT=3 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:31:13 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=4,cinder:INSERT=1,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:31:13 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 11:31:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:31:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:31:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:31:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:31:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:31:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:31:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.248s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:31:13 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:31:31 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-824cf9e2-d29f-4188-8eb1-9950b28dc7fa tempest-VolumesAdminNegativeTest-394246303 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:31:31 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-824cf9e2-d29f-4188-8eb1-9950b28dc7fa tempest-VolumesAdminNegativeTest-394246303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:31:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-824cf9e2-d29f-4188-8eb1-9950b28dc7fa tempest-VolumesAdminNegativeTest-394246303 None] Flow 'volume_create_manager' (b43ecc44-1fc5-4457-b6a7-1ccfade08331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:31:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-824cf9e2-d29f-4188-8eb1-9950b28dc7fa tempest-VolumesAdminNegativeTest-394246303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1da5db30-4e81-4ebf-a4f9-89686674ef27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:31:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-824cf9e2-d29f-4188-8eb1-9950b28dc7fa tempest-VolumesAdminNegativeTest-394246303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1da5db30-4e81-4ebf-a4f9-89686674ef27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-565925494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e6610c8-53f7-48d6-9a2f-43b5d9b90dce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e0e1f39603446fa831ff4f0438174ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:31:31Z,use_quota=True,user_id='4b21f22b589645489e5581d8a8178abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:31:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-824cf9e2-d29f-4188-8eb1-9950b28dc7fa tempest-VolumesAdminNegativeTest-394246303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28e0ed56-13ef-4a53-9d1c-8cb03d6dae4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:31:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-824cf9e2-d29f-4188-8eb1-9950b28dc7fa tempest-VolumesAdminNegativeTest-394246303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28e0ed56-13ef-4a53-9d1c-8cb03d6dae4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:31:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-824cf9e2-d29f-4188-8eb1-9950b28dc7fa tempest-VolumesAdminNegativeTest-394246303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86c52c9c-fcaa-4021-9de4-30d7a89b2347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:31:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-824cf9e2-d29f-4188-8eb1-9950b28dc7fa tempest-VolumesAdminNegativeTest-394246303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86c52c9c-fcaa-4021-9de4-30d7a89b2347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e6610c8-53f7-48d6-9a2f-43b5d9b90dce', 'volume_name': 'volume-9e6610c8-53f7-48d6-9a2f-43b5d9b90dce', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:31:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-824cf9e2-d29f-4188-8eb1-9950b28dc7fa tempest-VolumesAdminNegativeTest-394246303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e379ed3c-e0d5-4152-abb0-7eb68fd314ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:31:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-824cf9e2-d29f-4188-8eb1-9950b28dc7fa tempest-VolumesAdminNegativeTest-394246303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e379ed3c-e0d5-4152-abb0-7eb68fd314ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:31:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-824cf9e2-d29f-4188-8eb1-9950b28dc7fa tempest-VolumesAdminNegativeTest-394246303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5593f584-d744-4705-bffd-811baf6476a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:31:32 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-824cf9e2-d29f-4188-8eb1-9950b28dc7fa tempest-VolumesAdminNegativeTest-394246303 None] Volume 9e6610c8-53f7-48d6-9a2f-43b5d9b90dce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e6610c8-53f7-48d6-9a2f-43b5d9b90dce', 'volume_size': 1}
Sep 18 11:31:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-824cf9e2-d29f-4188-8eb1-9950b28dc7fa tempest-VolumesAdminNegativeTest-394246303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:31:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-824cf9e2-d29f-4188-8eb1-9950b28dc7fa tempest-VolumesAdminNegativeTest-394246303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:31:32 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-824cf9e2-d29f-4188-8eb1-9950b28dc7fa tempest-VolumesAdminNegativeTest-394246303 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-565925494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e6610c8-53f7-48d6-9a2f-43b5d9b90dce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e0e1f39603446fa831ff4f0438174ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:31:31Z,use_quota=True,user_id='4b21f22b589645489e5581d8a8178abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:31:32 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-824cf9e2-d29f-4188-8eb1-9950b28dc7fa tempest-VolumesAdminNegativeTest-394246303 None] Creating volume 9e6610c8-53f7-48d6-9a2f-43b5d9b90dce {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:31:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-824cf9e2-d29f-4188-8eb1-9950b28dc7fa tempest-VolumesAdminNegativeTest-394246303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:31:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-824cf9e2-d29f-4188-8eb1-9950b28dc7fa tempest-VolumesAdminNegativeTest-394246303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:31:32 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-824cf9e2-d29f-4188-8eb1-9950b28dc7fa tempest-VolumesAdminNegativeTest-394246303 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:31:32 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-824cf9e2-d29f-4188-8eb1-9950b28dc7fa tempest-VolumesAdminNegativeTest-394246303 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:31:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-824cf9e2-d29f-4188-8eb1-9950b28dc7fa tempest-VolumesAdminNegativeTest-394246303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:31:32 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-824cf9e2-d29f-4188-8eb1-9950b28dc7fa tempest-VolumesAdminNegativeTest-394246303 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:31:32 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-824cf9e2-d29f-4188-8eb1-9950b28dc7fa tempest-VolumesAdminNegativeTest-394246303 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:31:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-824cf9e2-d29f-4188-8eb1-9950b28dc7fa tempest-VolumesAdminNegativeTest-394246303 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-9e6610c8-53f7-48d6-9a2f-43b5d9b90dce 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:31:32 devstack quobyte-client[83193]: System call of process 86970 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:31:32 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=6, name=volume-9e6610c8-53f7-48d6-9a2f-43b5d9b90dce, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:31:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-824cf9e2-d29f-4188-8eb1-9950b28dc7fa tempest-VolumesAdminNegativeTest-394246303 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-9e6610c8-53f7-48d6-9a2f-43b5d9b90dce 1073741824" returned: 0 in 0.675s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:31:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-824cf9e2-d29f-4188-8eb1-9950b28dc7fa tempest-VolumesAdminNegativeTest-394246303 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-9e6610c8-53f7-48d6-9a2f-43b5d9b90dce {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:31:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-824cf9e2-d29f-4188-8eb1-9950b28dc7fa tempest-VolumesAdminNegativeTest-394246303 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-9e6610c8-53f7-48d6-9a2f-43b5d9b90dce" returned: 0 in 0.417s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:31:33 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-824cf9e2-d29f-4188-8eb1-9950b28dc7fa tempest-VolumesAdminNegativeTest-394246303 None] <== create_volume: return (1302ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:31:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-824cf9e2-d29f-4188-8eb1-9950b28dc7fa tempest-VolumesAdminNegativeTest-394246303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.323s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:31:34 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-824cf9e2-d29f-4188-8eb1-9950b28dc7fa tempest-VolumesAdminNegativeTest-394246303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5593f584-d744-4705-bffd-811baf6476a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e6610c8-53f7-48d6-9a2f-43b5d9b90dce', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:31:34 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-824cf9e2-d29f-4188-8eb1-9950b28dc7fa tempest-VolumesAdminNegativeTest-394246303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc699bc0-7b8e-4183-8dc1-0e7d6bbe1f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:31:34 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-824cf9e2-d29f-4188-8eb1-9950b28dc7fa tempest-VolumesAdminNegativeTest-394246303 None] Volume volume-9e6610c8-53f7-48d6-9a2f-43b5d9b90dce (9e6610c8-53f7-48d6-9a2f-43b5d9b90dce): created successfully
Sep 18 11:31:34 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-824cf9e2-d29f-4188-8eb1-9950b28dc7fa tempest-VolumesAdminNegativeTest-394246303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc699bc0-7b8e-4183-8dc1-0e7d6bbe1f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:31:34 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-824cf9e2-d29f-4188-8eb1-9950b28dc7fa tempest-VolumesAdminNegativeTest-394246303 None] Flow 'volume_create_manager' (b43ecc44-1fc5-4457-b6a7-1ccfade08331) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:31:34 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-824cf9e2-d29f-4188-8eb1-9950b28dc7fa tempest-VolumesAdminNegativeTest-394246303 None] Created volume successfully.
Sep 18 11:31:36 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-bdfc6115-8c4c-441e-89c8-930af0ac8df4 tempest-VolumesAdminNegativeTest-394246303 None] Acquiring lock "cinder-9e6610c8-53f7-48d6-9a2f-43b5d9b90dce-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:31:36 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-bdfc6115-8c4c-441e-89c8-930af0ac8df4 tempest-VolumesAdminNegativeTest-394246303 None] Lock "cinder-9e6610c8-53f7-48d6-9a2f-43b5d9b90dce-delete_volume" acquired by "delete_volume" :: waited 0.118s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:31:36 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-bdfc6115-8c4c-441e-89c8-930af0ac8df4 tempest-VolumesAdminNegativeTest-394246303 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:31:36 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-bdfc6115-8c4c-441e-89c8-930af0ac8df4 tempest-VolumesAdminNegativeTest-394246303 None] Acquiring lock "cinder-quobyte-9e6610c8-53f7-48d6-9a2f-43b5d9b90dce" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:31:36 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-bdfc6115-8c4c-441e-89c8-930af0ac8df4 tempest-VolumesAdminNegativeTest-394246303 None] Lock "cinder-quobyte-9e6610c8-53f7-48d6-9a2f-43b5d9b90dce" acquired by "delete_volume" :: waited 0.015s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:31:36 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e61dbab-6e07-414a-9dcd-3aecefd4d116]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:31:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-bdfc6115-8c4c-441e-89c8-930af0ac8df4 tempest-VolumesAdminNegativeTest-394246303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-9e6610c8-53f7-48d6-9a2f-43b5d9b90dce {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:31:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-bdfc6115-8c4c-441e-89c8-930af0ac8df4 tempest-VolumesAdminNegativeTest-394246303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-9e6610c8-53f7-48d6-9a2f-43b5d9b90dce" returned: 0 in 0.549s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:31:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-bdfc6115-8c4c-441e-89c8-930af0ac8df4 tempest-VolumesAdminNegativeTest-394246303 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-9e6610c8-53f7-48d6-9a2f-43b5d9b90dce {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:31:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-bdfc6115-8c4c-441e-89c8-930af0ac8df4 tempest-VolumesAdminNegativeTest-394246303 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-9e6610c8-53f7-48d6-9a2f-43b5d9b90dce" returned: 0 in 0.144s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:31:37 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-bdfc6115-8c4c-441e-89c8-930af0ac8df4 tempest-VolumesAdminNegativeTest-394246303 None] Lock "cinder-quobyte-9e6610c8-53f7-48d6-9a2f-43b5d9b90dce" released by "delete_volume" :: held 1.017s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:31:38 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-bdfc6115-8c4c-441e-89c8-930af0ac8df4 tempest-VolumesAdminNegativeTest-394246303 None] Created reservations ['cf45d699-40ff-43b8-8465-4910c27448a3', 'e1721fda-a70b-4230-a9c1-c8567e575d87', 'b2f6edf7-fe4e-4e8a-8b31-93c88eeaebeb', '4b93a029-1eeb-4076-a039-81ed3088e9b2'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:31:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-bdfc6115-8c4c-441e-89c8-930af0ac8df4 tempest-VolumesAdminNegativeTest-394246303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:31:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-bdfc6115-8c4c-441e-89c8-930af0ac8df4 tempest-VolumesAdminNegativeTest-394246303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:31:38 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-bdfc6115-8c4c-441e-89c8-930af0ac8df4 tempest-VolumesAdminNegativeTest-394246303 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:31:38 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-bdfc6115-8c4c-441e-89c8-930af0ac8df4 tempest-VolumesAdminNegativeTest-394246303 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:31:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-bdfc6115-8c4c-441e-89c8-930af0ac8df4 tempest-VolumesAdminNegativeTest-394246303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:31:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-bdfc6115-8c4c-441e-89c8-930af0ac8df4 tempest-VolumesAdminNegativeTest-394246303 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:31:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-bdfc6115-8c4c-441e-89c8-930af0ac8df4 tempest-VolumesAdminNegativeTest-394246303 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.240s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:31:38 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-bdfc6115-8c4c-441e-89c8-930af0ac8df4 tempest-VolumesAdminNegativeTest-394246303 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:31:39 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-bdfc6115-8c4c-441e-89c8-930af0ac8df4 tempest-VolumesAdminNegativeTest-394246303 None] Deleted volume successfully.
Sep 18 11:31:39 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-bdfc6115-8c4c-441e-89c8-930af0ac8df4 tempest-VolumesAdminNegativeTest-394246303 None] Lock "cinder-9e6610c8-53f7-48d6-9a2f-43b5d9b90dce-delete_volume" released by "delete_volume" :: held 2.986s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:31:48 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=6,cinder:UPDATE=11,cinder:INSERT=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:31:49 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:UPDATE=9,cinder:DELETE=2,cinder:SELECT=6,cinder:INSERT=3 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:32:01 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-10f37888-b2e1-4898-a1b6-82d70e996ce6 tempest-TaggedAttachmentsTest-2061971130 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:32:01 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-10f37888-b2e1-4898-a1b6-82d70e996ce6 tempest-TaggedAttachmentsTest-2061971130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:32:01 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-10f37888-b2e1-4898-a1b6-82d70e996ce6 tempest-TaggedAttachmentsTest-2061971130 None] Flow 'volume_create_manager' (babc996a-a4e3-4061-b35b-f88fe34ac11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:32:01 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-10f37888-b2e1-4898-a1b6-82d70e996ce6 tempest-TaggedAttachmentsTest-2061971130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e82b076-d8c9-4b97-9c09-fb8a6955ab38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:32:01 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-10f37888-b2e1-4898-a1b6-82d70e996ce6 tempest-TaggedAttachmentsTest-2061971130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e82b076-d8c9-4b97-9c09-fb8a6955ab38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:32:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1633382652',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c6e71b6-d133-4db5-af6d-f8929b802416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72b4a83fd2af4cd0b3d241ecfc28b81b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:32:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:32:01Z,use_quota=True,user_id='b2daac3f27624824b7b635386bc2dcf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:32:01 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-10f37888-b2e1-4898-a1b6-82d70e996ce6 tempest-TaggedAttachmentsTest-2061971130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a9ff5df-640d-4b25-8f37-be154d73c571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:32:01 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-10f37888-b2e1-4898-a1b6-82d70e996ce6 tempest-TaggedAttachmentsTest-2061971130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a9ff5df-640d-4b25-8f37-be154d73c571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:32:01 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-10f37888-b2e1-4898-a1b6-82d70e996ce6 tempest-TaggedAttachmentsTest-2061971130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10c6fbf0-e285-4abe-a99d-babd5c9e58ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:32:01 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-10f37888-b2e1-4898-a1b6-82d70e996ce6 tempest-TaggedAttachmentsTest-2061971130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10c6fbf0-e285-4abe-a99d-babd5c9e58ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c6e71b6-d133-4db5-af6d-f8929b802416', 'volume_name': 'volume-5c6e71b6-d133-4db5-af6d-f8929b802416', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:32:01 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-10f37888-b2e1-4898-a1b6-82d70e996ce6 tempest-TaggedAttachmentsTest-2061971130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7ff022a-2d29-4ead-9362-68b5e3cc427f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:32:01 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-10f37888-b2e1-4898-a1b6-82d70e996ce6 tempest-TaggedAttachmentsTest-2061971130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7ff022a-2d29-4ead-9362-68b5e3cc427f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:32:01 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-10f37888-b2e1-4898-a1b6-82d70e996ce6 tempest-TaggedAttachmentsTest-2061971130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0514ec7-7f55-4797-a611-6874725a51ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:32:01 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-10f37888-b2e1-4898-a1b6-82d70e996ce6 tempest-TaggedAttachmentsTest-2061971130 None] Volume 5c6e71b6-d133-4db5-af6d-f8929b802416: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c6e71b6-d133-4db5-af6d-f8929b802416', 'volume_size': 1}
Sep 18 11:32:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-10f37888-b2e1-4898-a1b6-82d70e996ce6 tempest-TaggedAttachmentsTest-2061971130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:32:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-10f37888-b2e1-4898-a1b6-82d70e996ce6 tempest-TaggedAttachmentsTest-2061971130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:32:01 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-10f37888-b2e1-4898-a1b6-82d70e996ce6 tempest-TaggedAttachmentsTest-2061971130 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:32:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1633382652',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c6e71b6-d133-4db5-af6d-f8929b802416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72b4a83fd2af4cd0b3d241ecfc28b81b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:32:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:32:01Z,use_quota=True,user_id='b2daac3f27624824b7b635386bc2dcf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:32:01 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-10f37888-b2e1-4898-a1b6-82d70e996ce6 tempest-TaggedAttachmentsTest-2061971130 None] Creating volume 5c6e71b6-d133-4db5-af6d-f8929b802416 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:32:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-10f37888-b2e1-4898-a1b6-82d70e996ce6 tempest-TaggedAttachmentsTest-2061971130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:32:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-10f37888-b2e1-4898-a1b6-82d70e996ce6 tempest-TaggedAttachmentsTest-2061971130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:32:01 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-10f37888-b2e1-4898-a1b6-82d70e996ce6 tempest-TaggedAttachmentsTest-2061971130 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:32:02 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-10f37888-b2e1-4898-a1b6-82d70e996ce6 tempest-TaggedAttachmentsTest-2061971130 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:32:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-10f37888-b2e1-4898-a1b6-82d70e996ce6 tempest-TaggedAttachmentsTest-2061971130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:32:02 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-10f37888-b2e1-4898-a1b6-82d70e996ce6 tempest-TaggedAttachmentsTest-2061971130 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:32:02 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-10f37888-b2e1-4898-a1b6-82d70e996ce6 tempest-TaggedAttachmentsTest-2061971130 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:32:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-10f37888-b2e1-4898-a1b6-82d70e996ce6 tempest-TaggedAttachmentsTest-2061971130 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5c6e71b6-d133-4db5-af6d-f8929b802416 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:32:02 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=7, name=volume-5c6e71b6-d133-4db5-af6d-f8929b802416, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:32:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-10f37888-b2e1-4898-a1b6-82d70e996ce6 tempest-TaggedAttachmentsTest-2061971130 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5c6e71b6-d133-4db5-af6d-f8929b802416 1073741824" returned: 0 in 0.423s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:32:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-10f37888-b2e1-4898-a1b6-82d70e996ce6 tempest-TaggedAttachmentsTest-2061971130 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5c6e71b6-d133-4db5-af6d-f8929b802416 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:32:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-10f37888-b2e1-4898-a1b6-82d70e996ce6 tempest-TaggedAttachmentsTest-2061971130 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5c6e71b6-d133-4db5-af6d-f8929b802416" returned: 0 in 0.129s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:32:02 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-10f37888-b2e1-4898-a1b6-82d70e996ce6 tempest-TaggedAttachmentsTest-2061971130 None] <== create_volume: return (640ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:32:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-10f37888-b2e1-4898-a1b6-82d70e996ce6 tempest-TaggedAttachmentsTest-2061971130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.656s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:32:02 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-10f37888-b2e1-4898-a1b6-82d70e996ce6 tempest-TaggedAttachmentsTest-2061971130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0514ec7-7f55-4797-a611-6874725a51ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c6e71b6-d133-4db5-af6d-f8929b802416', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:32:02 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-10f37888-b2e1-4898-a1b6-82d70e996ce6 tempest-TaggedAttachmentsTest-2061971130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a356486-67fb-47bf-9885-769c7e755a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:32:02 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-10f37888-b2e1-4898-a1b6-82d70e996ce6 tempest-TaggedAttachmentsTest-2061971130 None] Volume volume-5c6e71b6-d133-4db5-af6d-f8929b802416 (5c6e71b6-d133-4db5-af6d-f8929b802416): created successfully
Sep 18 11:32:02 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-10f37888-b2e1-4898-a1b6-82d70e996ce6 tempest-TaggedAttachmentsTest-2061971130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a356486-67fb-47bf-9885-769c7e755a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:32:03 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-10f37888-b2e1-4898-a1b6-82d70e996ce6 tempest-TaggedAttachmentsTest-2061971130 None] Flow 'volume_create_manager' (babc996a-a4e3-4061-b35b-f88fe34ac11f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:32:03 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-10f37888-b2e1-4898-a1b6-82d70e996ce6 tempest-TaggedAttachmentsTest-2061971130 None] Created volume successfully.
Sep 18 11:32:13 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:32:13 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:UPDATE=2,cinder:DELETE=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:32:13 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 11:32:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:32:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:32:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:32:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:32:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:32:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:32:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.178s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:32:13 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:32:43 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:33:13 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 11:33:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:33:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:33:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:33:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:33:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:33:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:33:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.315s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:33:14 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:33:26 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:33:26 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:33:26 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Flow 'volume_create_manager' (8480825e-21f2-4e8f-a31a-290bf1a14f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:33:26 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc782d57-ebcc-4f4e-a5bc-4cd11917e200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:33:26 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc782d57-ebcc-4f4e-a5bc-4cd11917e200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1401880421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa0f4605-3d3e-4092-8d32-f88d3a202cc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ee99590997849e0b7dbec30701618bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:33:26Z,use_quota=True,user_id='5a0a748cd4bc4cc1a45930e6c2dd0103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:33:26 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f6000f0-0c1c-40e3-9eff-37cf564e821f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:33:26 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f6000f0-0c1c-40e3-9eff-37cf564e821f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:33:26 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d5861b1-4ea0-4bbf-97aa-775770e31d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:33:26 devstack cinder-volume[83176]: DEBUG cinder.image.glance [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Creating Keystone auth plugin from conf {{(pid=83176) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 18 11:33:27 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d5861b1-4ea0-4bbf-97aa-775770e31d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'aa0f4605-3d3e-4092-8d32-f88d3a202cc5', 'volume_name': 'volume-aa0f4605-3d3e-4092-8d32-f88d3a202cc5', 'volume_size': 1, 'image_id': 'd8f06519-8e17-49ea-ac0c-4df29f548619', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8f06519-8e17-49ea-ac0c-4df29f548619', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '68bc9b408b424a06a12482824dcdb45c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8f06519-8e17-49ea-ac0c-4df29f548619', 'created_at': datetime.datetime(2025, 9, 18, 9, 18, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 9, 18, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8f06519-8e17-49ea-ac0c-4df29f548619/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6ae45315d0>}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:33:27 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d64ac671-6f9f-4cb1-a8a1-561d1542ea44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:33:27 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d64ac671-6f9f-4cb1-a8a1-561d1542ea44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:33:27 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad782c5c-d3c8-40a3-942a-ddbc6b15e76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:33:27 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Volume aa0f4605-3d3e-4092-8d32-f88d3a202cc5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-aa0f4605-3d3e-4092-8d32-f88d3a202cc5', 'volume_size': 1, 'image_id': 'd8f06519-8e17-49ea-ac0c-4df29f548619', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8f06519-8e17-49ea-ac0c-4df29f548619', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '68bc9b408b424a06a12482824dcdb45c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8f06519-8e17-49ea-ac0c-4df29f548619', 'created_at': datetime.datetime(2025, 9, 18, 9, 18, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 9, 18, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8f06519-8e17-49ea-ac0c-4df29f548619/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6ae45315d0>}
Sep 18 11:33:27 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Cloning aa0f4605-3d3e-4092-8d32-f88d3a202cc5 from image d8f06519-8e17-49ea-ac0c-4df29f548619  at location (None, [{'url': 'file:///opt/stack/data/glance/images/d8f06519-8e17-49ea-ac0c-4df29f548619', 'metadata': {}}]). {{(pid=83176) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 18 11:33:28 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_q59ozd53devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83176) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 18 11:33:28 devstack cinder-volume[83176]: INFO cinder.image.image_utils [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Image download 20.69 MB at 20.69 MB/s
Sep 18 11:33:28 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ecc9328-3d51-4fdc-b054-36e435553d7e]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:33:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_q59ozd53devstack@QuobyteHD {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:33:29 devstack sudo[87439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_q59ozd53devstack@QuobyteHD
Sep 18 11:33:29 devstack sudo[87439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:33:32 devstack sudo[87439]: pam_unix(sudo:session): session closed for user root
Sep 18 11:33:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_q59ozd53devstack@QuobyteHD" returned: 0 in 4.078s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:33:32 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Temporary image d8f06519-8e17-49ea-ac0c-4df29f548619 is fetched for user 5a0a748cd4bc4cc1a45930e6c2dd0103. {{(pid=83176) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 18 11:33:33 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ac1115-e8a8-4f55-8872-d35d0e9e1ec0]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:33:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_q59ozd53devstack@QuobyteHD {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:33:33 devstack sudo[87477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_q59ozd53devstack@QuobyteHD
Sep 18 11:33:33 devstack sudo[87477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:33:35 devstack sudo[87477]: pam_unix(sudo:session): session closed for user root
Sep 18 11:33:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_q59ozd53devstack@QuobyteHD" returned: 0 in 2.715s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:33:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:33:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:33:36 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1401880421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa0f4605-3d3e-4092-8d32-f88d3a202cc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ee99590997849e0b7dbec30701618bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:33:26Z,use_quota=True,user_id='5a0a748cd4bc4cc1a45930e6c2dd0103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:33:36 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Creating volume aa0f4605-3d3e-4092-8d32-f88d3a202cc5 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:33:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:33:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:33:36 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:33:36 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:33:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:33:36 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:33:36 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:33:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-aa0f4605-3d3e-4092-8d32-f88d3a202cc5 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:33:36 devstack quobyte-client[83193]: System call of process 87482 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:33:36 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=8, name=volume-aa0f4605-3d3e-4092-8d32-f88d3a202cc5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:33:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-aa0f4605-3d3e-4092-8d32-f88d3a202cc5 1073741824" returned: 0 in 0.478s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:33:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-aa0f4605-3d3e-4092-8d32-f88d3a202cc5 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:33:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-aa0f4605-3d3e-4092-8d32-f88d3a202cc5" returned: 0 in 0.116s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:33:36 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] <== create_volume: return (703ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:33:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:33:36 devstack cinder-volume[83176]: DEBUG cinder.volume.volume_utils [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Attempting download of d8f06519-8e17-49ea-ac0c-4df29f548619 ((None, [{'url': 'file:///opt/stack/data/glance/images/d8f06519-8e17-49ea-ac0c-4df29f548619', 'metadata': {}}])) to volume aa0f4605-3d3e-4092-8d32-f88d3a202cc5. {{(pid=83176) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 18 11:33:37 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2347c2da-2c08-4c8f-a422-2f831a865825]: (4, 'raw') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:33:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8f06519-8e17-49ea-ac0c-4df29f548619_v8s_qz7i {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:33:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8f06519-8e17-49ea-ac0c-4df29f548619_v8s_qz7i" returned: 0 in 0.510s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:33:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8f06519-8e17-49ea-ac0c-4df29f548619_v8s_qz7i {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:33:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8f06519-8e17-49ea-ac0c-4df29f548619_v8s_qz7i" returned: 1 in 0.495s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:33:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8f06519-8e17-49ea-ac0c-4df29f548619_v8s_qz7i' failed. Not Retrying. {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 11:33:38 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f6656a-cb9a-46d5-9d2f-82c184ed965c]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:33:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_q59ozd53devstack@QuobyteHD {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:33:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_q59ozd53devstack@QuobyteHD" returned: 0 in 0.473s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:33:38 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] d8f06519-8e17-49ea-ac0c-4df29f548619 was qcow2, converting to raw {{(pid=83176) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 18 11:33:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_q59ozd53devstack@QuobyteHD /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-aa0f4605-3d3e-4092-8d32-f88d3a202cc5 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:33:38 devstack quobyte-client[83193]: System call of process 87493 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:33:38 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=8, name=volume-aa0f4605-3d3e-4092-8d32-f88d3a202cc5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:33:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_q59ozd53devstack@QuobyteHD /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-aa0f4605-3d3e-4092-8d32-f88d3a202cc5" returned: 0 in 1.528s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:33:40 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_q59ozd53devstack@QuobyteHD, size 112.00 MB, duration 1.56 sec, destination /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-aa0f4605-3d3e-4092-8d32-f88d3a202cc5 {{(pid=83176) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 11:33:40 devstack cinder-volume[83176]: INFO cinder.image.image_utils [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Converted 112.00 MB image at 71.64 MB/s
Sep 18 11:33:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-aa0f4605-3d3e-4092-8d32-f88d3a202cc5 1G {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:33:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-aa0f4605-3d3e-4092-8d32-f88d3a202cc5 1G" returned: 0 in 0.184s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:33:40 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd2d716-0583-45ec-a788-f64960d0d41e]: (4, 'raw') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:33:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-aa0f4605-3d3e-4092-8d32-f88d3a202cc5 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:33:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-aa0f4605-3d3e-4092-8d32-f88d3a202cc5" returned: 0 in 0.431s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:33:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-aa0f4605-3d3e-4092-8d32-f88d3a202cc5 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:33:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-aa0f4605-3d3e-4092-8d32-f88d3a202cc5" returned: 1 in 0.458s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:33:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-aa0f4605-3d3e-4092-8d32-f88d3a202cc5' failed. Not Retrying. {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 11:33:41 devstack cinder-volume[83176]: DEBUG cinder.volume.volume_utils [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Downloaded image d8f06519-8e17-49ea-ac0c-4df29f548619 ((None, [{'url': 'file:///opt/stack/data/glance/images/d8f06519-8e17-49ea-ac0c-4df29f548619', 'metadata': {}}])) to volume aa0f4605-3d3e-4092-8d32-f88d3a202cc5 successfully. {{(pid=83176) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 18 11:33:41 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Temporary image d8f06519-8e17-49ea-ac0c-4df29f548619 for user 5a0a748cd4bc4cc1a45930e6c2dd0103 is deleted. {{(pid=83176) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 18 11:33:41 devstack cinder-volume[83176]: DEBUG cinder.volume.volume_utils [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Marking volume aa0f4605-3d3e-4092-8d32-f88d3a202cc5 as bootable. {{(pid=83176) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 18 11:33:41 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Copying metadata from image d8f06519-8e17-49ea-ac0c-4df29f548619 to aa0f4605-3d3e-4092-8d32-f88d3a202cc5. {{(pid=83176) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 18 11:33:41 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Creating volume glance metadata for volume aa0f4605-3d3e-4092-8d32-f88d3a202cc5 backed by image d8f06519-8e17-49ea-ac0c-4df29f548619 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd8f06519-8e17-49ea-ac0c-4df29f548619', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83176) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 18 11:33:42 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad782c5c-d3c8-40a3-942a-ddbc6b15e76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa0f4605-3d3e-4092-8d32-f88d3a202cc5', 'volume_size': 1, 'image_id': 'd8f06519-8e17-49ea-ac0c-4df29f548619', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8f06519-8e17-49ea-ac0c-4df29f548619', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '68bc9b408b424a06a12482824dcdb45c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8f06519-8e17-49ea-ac0c-4df29f548619', 'created_at': datetime.datetime(2025, 9, 18, 9, 18, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 9, 18, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8f06519-8e17-49ea-ac0c-4df29f548619/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6ae45315d0>}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:33:42 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43c90b1d-7333-49a6-a80a-1ad96b173bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:33:42 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Volume volume-aa0f4605-3d3e-4092-8d32-f88d3a202cc5 (aa0f4605-3d3e-4092-8d32-f88d3a202cc5): created successfully
Sep 18 11:33:42 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43c90b1d-7333-49a6-a80a-1ad96b173bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:33:42 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Flow 'volume_create_manager' (8480825e-21f2-4e8f-a31a-290bf1a14f28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:33:42 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-9741c9ce-4804-447f-89d6-7cf00fa7d4e4 tempest-TaggedBootDevicesTest-1687567533 None] Created volume successfully.
Sep 18 11:33:43 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-4f3c37be-f1f5-4c37-a91b-078e7da0569b tempest-TaggedBootDevicesTest-1687567533 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:33:43 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f3c37be-f1f5-4c37-a91b-078e7da0569b tempest-TaggedBootDevicesTest-1687567533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:33:43 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4f3c37be-f1f5-4c37-a91b-078e7da0569b tempest-TaggedBootDevicesTest-1687567533 None] Flow 'volume_create_manager' (2104986e-546d-4249-bb12-f6f7152fa54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:33:43 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4f3c37be-f1f5-4c37-a91b-078e7da0569b tempest-TaggedBootDevicesTest-1687567533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bb98b28-91e2-4f29-ae21-0997c9a865fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:33:43 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4f3c37be-f1f5-4c37-a91b-078e7da0569b tempest-TaggedBootDevicesTest-1687567533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bb98b28-91e2-4f29-ae21-0997c9a865fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-214979662',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f79f2e6b-9bc6-431a-a74c-9c406afa1f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ee99590997849e0b7dbec30701618bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:33:44Z,use_quota=True,user_id='5a0a748cd4bc4cc1a45930e6c2dd0103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:33:43 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4f3c37be-f1f5-4c37-a91b-078e7da0569b tempest-TaggedBootDevicesTest-1687567533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7912435f-793e-4d4e-8756-c075d4a8e7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:33:43 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4f3c37be-f1f5-4c37-a91b-078e7da0569b tempest-TaggedBootDevicesTest-1687567533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7912435f-793e-4d4e-8756-c075d4a8e7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:33:43 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4f3c37be-f1f5-4c37-a91b-078e7da0569b tempest-TaggedBootDevicesTest-1687567533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ac845c3-75bc-4bd6-bf7b-442a784470d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:33:43 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4f3c37be-f1f5-4c37-a91b-078e7da0569b tempest-TaggedBootDevicesTest-1687567533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ac845c3-75bc-4bd6-bf7b-442a784470d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f79f2e6b-9bc6-431a-a74c-9c406afa1f8c', 'volume_name': 'volume-f79f2e6b-9bc6-431a-a74c-9c406afa1f8c', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:33:43 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4f3c37be-f1f5-4c37-a91b-078e7da0569b tempest-TaggedBootDevicesTest-1687567533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11047303-6312-4a4c-befb-85b07afcac06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:33:43 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4f3c37be-f1f5-4c37-a91b-078e7da0569b tempest-TaggedBootDevicesTest-1687567533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11047303-6312-4a4c-befb-85b07afcac06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:33:43 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4f3c37be-f1f5-4c37-a91b-078e7da0569b tempest-TaggedBootDevicesTest-1687567533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbe028aa-5fb7-4ecf-bc46-d1015a9292a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:33:43 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-4f3c37be-f1f5-4c37-a91b-078e7da0569b tempest-TaggedBootDevicesTest-1687567533 None] Volume f79f2e6b-9bc6-431a-a74c-9c406afa1f8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f79f2e6b-9bc6-431a-a74c-9c406afa1f8c', 'volume_size': 1}
Sep 18 11:33:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4f3c37be-f1f5-4c37-a91b-078e7da0569b tempest-TaggedBootDevicesTest-1687567533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:33:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4f3c37be-f1f5-4c37-a91b-078e7da0569b tempest-TaggedBootDevicesTest-1687567533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:33:43 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-4f3c37be-f1f5-4c37-a91b-078e7da0569b tempest-TaggedBootDevicesTest-1687567533 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-214979662',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f79f2e6b-9bc6-431a-a74c-9c406afa1f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ee99590997849e0b7dbec30701618bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:33:44Z,use_quota=True,user_id='5a0a748cd4bc4cc1a45930e6c2dd0103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:33:43 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-4f3c37be-f1f5-4c37-a91b-078e7da0569b tempest-TaggedBootDevicesTest-1687567533 None] Creating volume f79f2e6b-9bc6-431a-a74c-9c406afa1f8c {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:33:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4f3c37be-f1f5-4c37-a91b-078e7da0569b tempest-TaggedBootDevicesTest-1687567533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:33:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4f3c37be-f1f5-4c37-a91b-078e7da0569b tempest-TaggedBootDevicesTest-1687567533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:33:43 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-4f3c37be-f1f5-4c37-a91b-078e7da0569b tempest-TaggedBootDevicesTest-1687567533 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:33:43 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-4f3c37be-f1f5-4c37-a91b-078e7da0569b tempest-TaggedBootDevicesTest-1687567533 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:33:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4f3c37be-f1f5-4c37-a91b-078e7da0569b tempest-TaggedBootDevicesTest-1687567533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:33:43 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-4f3c37be-f1f5-4c37-a91b-078e7da0569b tempest-TaggedBootDevicesTest-1687567533 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:33:43 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-4f3c37be-f1f5-4c37-a91b-078e7da0569b tempest-TaggedBootDevicesTest-1687567533 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:33:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4f3c37be-f1f5-4c37-a91b-078e7da0569b tempest-TaggedBootDevicesTest-1687567533 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f79f2e6b-9bc6-431a-a74c-9c406afa1f8c 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:33:44 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=9, name=volume-f79f2e6b-9bc6-431a-a74c-9c406afa1f8c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:33:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4f3c37be-f1f5-4c37-a91b-078e7da0569b tempest-TaggedBootDevicesTest-1687567533 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f79f2e6b-9bc6-431a-a74c-9c406afa1f8c 1073741824" returned: 0 in 0.329s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:33:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4f3c37be-f1f5-4c37-a91b-078e7da0569b tempest-TaggedBootDevicesTest-1687567533 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f79f2e6b-9bc6-431a-a74c-9c406afa1f8c {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:33:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4f3c37be-f1f5-4c37-a91b-078e7da0569b tempest-TaggedBootDevicesTest-1687567533 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f79f2e6b-9bc6-431a-a74c-9c406afa1f8c" returned: 0 in 0.091s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:33:44 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-4f3c37be-f1f5-4c37-a91b-078e7da0569b tempest-TaggedBootDevicesTest-1687567533 None] <== create_volume: return (480ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:33:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4f3c37be-f1f5-4c37-a91b-078e7da0569b tempest-TaggedBootDevicesTest-1687567533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.493s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:33:44 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4f3c37be-f1f5-4c37-a91b-078e7da0569b tempest-TaggedBootDevicesTest-1687567533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbe028aa-5fb7-4ecf-bc46-d1015a9292a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f79f2e6b-9bc6-431a-a74c-9c406afa1f8c', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:33:44 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4f3c37be-f1f5-4c37-a91b-078e7da0569b tempest-TaggedBootDevicesTest-1687567533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b51e2484-d340-4c5a-bb9a-252248b59f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:33:44 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-4f3c37be-f1f5-4c37-a91b-078e7da0569b tempest-TaggedBootDevicesTest-1687567533 None] Volume volume-f79f2e6b-9bc6-431a-a74c-9c406afa1f8c (f79f2e6b-9bc6-431a-a74c-9c406afa1f8c): created successfully
Sep 18 11:33:44 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4f3c37be-f1f5-4c37-a91b-078e7da0569b tempest-TaggedBootDevicesTest-1687567533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b51e2484-d340-4c5a-bb9a-252248b59f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:33:44 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4f3c37be-f1f5-4c37-a91b-078e7da0569b tempest-TaggedBootDevicesTest-1687567533 None] Flow 'volume_create_manager' (2104986e-546d-4249-bb12-f6f7152fa54c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:33:44 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-4f3c37be-f1f5-4c37-a91b-078e7da0569b tempest-TaggedBootDevicesTest-1687567533 None] Created volume successfully.
Sep 18 11:33:45 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-2706b999-6b99-489a-82c9-71cdd245c6c7 tempest-TaggedBootDevicesTest-1687567533 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:33:45 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-2706b999-6b99-489a-82c9-71cdd245c6c7 tempest-TaggedBootDevicesTest-1687567533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:33:45 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2706b999-6b99-489a-82c9-71cdd245c6c7 tempest-TaggedBootDevicesTest-1687567533 None] Flow 'volume_create_manager' (ff2cd50d-dd77-4022-bf9a-da6e5cd56456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:33:45 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2706b999-6b99-489a-82c9-71cdd245c6c7 tempest-TaggedBootDevicesTest-1687567533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4165d80d-5303-48bb-9d03-2df25d136676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:33:45 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2706b999-6b99-489a-82c9-71cdd245c6c7 tempest-TaggedBootDevicesTest-1687567533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4165d80d-5303-48bb-9d03-2df25d136676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-345137519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9c8f419-a659-40bc-ae4f-c6c2caf8abf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ee99590997849e0b7dbec30701618bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:33:45Z,use_quota=True,user_id='5a0a748cd4bc4cc1a45930e6c2dd0103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:33:45 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2706b999-6b99-489a-82c9-71cdd245c6c7 tempest-TaggedBootDevicesTest-1687567533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7088398-fc04-499e-9a87-25ceb8a67a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:33:45 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2706b999-6b99-489a-82c9-71cdd245c6c7 tempest-TaggedBootDevicesTest-1687567533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7088398-fc04-499e-9a87-25ceb8a67a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:33:45 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2706b999-6b99-489a-82c9-71cdd245c6c7 tempest-TaggedBootDevicesTest-1687567533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea88b1af-e52d-43b0-8770-ace3ebcfef78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:33:45 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2706b999-6b99-489a-82c9-71cdd245c6c7 tempest-TaggedBootDevicesTest-1687567533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea88b1af-e52d-43b0-8770-ace3ebcfef78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9c8f419-a659-40bc-ae4f-c6c2caf8abf9', 'volume_name': 'volume-f9c8f419-a659-40bc-ae4f-c6c2caf8abf9', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:33:45 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2706b999-6b99-489a-82c9-71cdd245c6c7 tempest-TaggedBootDevicesTest-1687567533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2431b4b-e9d9-4c02-806a-3a33352b665b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:33:45 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2706b999-6b99-489a-82c9-71cdd245c6c7 tempest-TaggedBootDevicesTest-1687567533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2431b4b-e9d9-4c02-806a-3a33352b665b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:33:45 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2706b999-6b99-489a-82c9-71cdd245c6c7 tempest-TaggedBootDevicesTest-1687567533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaeaa361-557f-45dd-b9eb-2c76480a6093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:33:45 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-2706b999-6b99-489a-82c9-71cdd245c6c7 tempest-TaggedBootDevicesTest-1687567533 None] Volume f9c8f419-a659-40bc-ae4f-c6c2caf8abf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9c8f419-a659-40bc-ae4f-c6c2caf8abf9', 'volume_size': 1}
Sep 18 11:33:45 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-2706b999-6b99-489a-82c9-71cdd245c6c7 tempest-TaggedBootDevicesTest-1687567533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:33:45 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-2706b999-6b99-489a-82c9-71cdd245c6c7 tempest-TaggedBootDevicesTest-1687567533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:33:45 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-2706b999-6b99-489a-82c9-71cdd245c6c7 tempest-TaggedBootDevicesTest-1687567533 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-345137519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9c8f419-a659-40bc-ae4f-c6c2caf8abf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ee99590997849e0b7dbec30701618bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:33:45Z,use_quota=True,user_id='5a0a748cd4bc4cc1a45930e6c2dd0103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:33:45 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-2706b999-6b99-489a-82c9-71cdd245c6c7 tempest-TaggedBootDevicesTest-1687567533 None] Creating volume f9c8f419-a659-40bc-ae4f-c6c2caf8abf9 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:33:45 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-2706b999-6b99-489a-82c9-71cdd245c6c7 tempest-TaggedBootDevicesTest-1687567533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:33:45 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-2706b999-6b99-489a-82c9-71cdd245c6c7 tempest-TaggedBootDevicesTest-1687567533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:33:45 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-2706b999-6b99-489a-82c9-71cdd245c6c7 tempest-TaggedBootDevicesTest-1687567533 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:33:45 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-2706b999-6b99-489a-82c9-71cdd245c6c7 tempest-TaggedBootDevicesTest-1687567533 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:33:45 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-2706b999-6b99-489a-82c9-71cdd245c6c7 tempest-TaggedBootDevicesTest-1687567533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:33:45 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-2706b999-6b99-489a-82c9-71cdd245c6c7 tempest-TaggedBootDevicesTest-1687567533 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:33:45 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-2706b999-6b99-489a-82c9-71cdd245c6c7 tempest-TaggedBootDevicesTest-1687567533 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:33:45 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2706b999-6b99-489a-82c9-71cdd245c6c7 tempest-TaggedBootDevicesTest-1687567533 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f9c8f419-a659-40bc-ae4f-c6c2caf8abf9 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:33:45 devstack quobyte-client[83193]: System call of process 87514 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:33:45 devstack quobyte-client[83193]: System call of process 87514 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:33:45 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=10, name=volume-f9c8f419-a659-40bc-ae4f-c6c2caf8abf9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:33:45 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2706b999-6b99-489a-82c9-71cdd245c6c7 tempest-TaggedBootDevicesTest-1687567533 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f9c8f419-a659-40bc-ae4f-c6c2caf8abf9 1073741824" returned: 0 in 0.358s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:33:45 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2706b999-6b99-489a-82c9-71cdd245c6c7 tempest-TaggedBootDevicesTest-1687567533 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f9c8f419-a659-40bc-ae4f-c6c2caf8abf9 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:33:46 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2706b999-6b99-489a-82c9-71cdd245c6c7 tempest-TaggedBootDevicesTest-1687567533 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f9c8f419-a659-40bc-ae4f-c6c2caf8abf9" returned: 0 in 0.080s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:33:46 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-2706b999-6b99-489a-82c9-71cdd245c6c7 tempest-TaggedBootDevicesTest-1687567533 None] <== create_volume: return (494ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:33:46 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-2706b999-6b99-489a-82c9-71cdd245c6c7 tempest-TaggedBootDevicesTest-1687567533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.505s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:33:46 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2706b999-6b99-489a-82c9-71cdd245c6c7 tempest-TaggedBootDevicesTest-1687567533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaeaa361-557f-45dd-b9eb-2c76480a6093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9c8f419-a659-40bc-ae4f-c6c2caf8abf9', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:33:46 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2706b999-6b99-489a-82c9-71cdd245c6c7 tempest-TaggedBootDevicesTest-1687567533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f30aa6f-3cb4-43f2-8e5e-8a116d28e4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:33:46 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-2706b999-6b99-489a-82c9-71cdd245c6c7 tempest-TaggedBootDevicesTest-1687567533 None] Volume volume-f9c8f419-a659-40bc-ae4f-c6c2caf8abf9 (f9c8f419-a659-40bc-ae4f-c6c2caf8abf9): created successfully
Sep 18 11:33:46 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2706b999-6b99-489a-82c9-71cdd245c6c7 tempest-TaggedBootDevicesTest-1687567533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f30aa6f-3cb4-43f2-8e5e-8a116d28e4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:33:46 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2706b999-6b99-489a-82c9-71cdd245c6c7 tempest-TaggedBootDevicesTest-1687567533 None] Flow 'volume_create_manager' (ff2cd50d-dd77-4022-bf9a-da6e5cd56456) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:33:46 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-2706b999-6b99-489a-82c9-71cdd245c6c7 tempest-TaggedBootDevicesTest-1687567533 None] Created volume successfully.
Sep 18 11:33:56 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=13,cinder:INSERT=4,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:33:56 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:UPDATE=7,cinder:SELECT=8,cinder:INSERT=9,cinder:DELETE=2 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:34:12 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-097e4001-7bf6-44c3-9982-4a521863ace3 tempest-AttachVolumeTestJSON-1453990575 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:34:12 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-097e4001-7bf6-44c3-9982-4a521863ace3 tempest-AttachVolumeTestJSON-1453990575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:34:12 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-097e4001-7bf6-44c3-9982-4a521863ace3 tempest-AttachVolumeTestJSON-1453990575 None] Flow 'volume_create_manager' (5c74e8ec-a299-4ac8-90e6-d5824511c488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:34:12 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-097e4001-7bf6-44c3-9982-4a521863ace3 tempest-AttachVolumeTestJSON-1453990575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d774de6-4e6f-4c75-aecb-613b6efd6b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:34:12 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-097e4001-7bf6-44c3-9982-4a521863ace3 tempest-AttachVolumeTestJSON-1453990575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d774de6-4e6f-4c75-aecb-613b6efd6b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1091426986',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5d26e94-6abd-4a0d-b4de-2c6c458265da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a8a837e06b4e66ae9eee5d6b4ead52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:34:11Z,use_quota=True,user_id='af8eee920c034ce78c561706f3fec005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:34:12 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-097e4001-7bf6-44c3-9982-4a521863ace3 tempest-AttachVolumeTestJSON-1453990575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af7e741-5fd9-4532-9740-8b381d4196b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:34:12 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-097e4001-7bf6-44c3-9982-4a521863ace3 tempest-AttachVolumeTestJSON-1453990575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af7e741-5fd9-4532-9740-8b381d4196b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:34:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-097e4001-7bf6-44c3-9982-4a521863ace3 tempest-AttachVolumeTestJSON-1453990575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fffbdb48-4fd9-4930-88e8-89c881f8e4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:34:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-097e4001-7bf6-44c3-9982-4a521863ace3 tempest-AttachVolumeTestJSON-1453990575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fffbdb48-4fd9-4930-88e8-89c881f8e4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5d26e94-6abd-4a0d-b4de-2c6c458265da', 'volume_name': 'volume-b5d26e94-6abd-4a0d-b4de-2c6c458265da', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:34:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-097e4001-7bf6-44c3-9982-4a521863ace3 tempest-AttachVolumeTestJSON-1453990575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94094fa5-46ee-4276-af48-14c9e5234391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:34:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-097e4001-7bf6-44c3-9982-4a521863ace3 tempest-AttachVolumeTestJSON-1453990575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94094fa5-46ee-4276-af48-14c9e5234391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:34:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-097e4001-7bf6-44c3-9982-4a521863ace3 tempest-AttachVolumeTestJSON-1453990575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adb5cc3d-eb71-45bd-b890-b9e49d7f96e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:34:13 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-097e4001-7bf6-44c3-9982-4a521863ace3 tempest-AttachVolumeTestJSON-1453990575 None] Volume b5d26e94-6abd-4a0d-b4de-2c6c458265da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5d26e94-6abd-4a0d-b4de-2c6c458265da', 'volume_size': 1}
Sep 18 11:34:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-097e4001-7bf6-44c3-9982-4a521863ace3 tempest-AttachVolumeTestJSON-1453990575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:34:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-097e4001-7bf6-44c3-9982-4a521863ace3 tempest-AttachVolumeTestJSON-1453990575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.022s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:34:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-097e4001-7bf6-44c3-9982-4a521863ace3 tempest-AttachVolumeTestJSON-1453990575 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1091426986',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5d26e94-6abd-4a0d-b4de-2c6c458265da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a8a837e06b4e66ae9eee5d6b4ead52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:34:11Z,use_quota=True,user_id='af8eee920c034ce78c561706f3fec005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:34:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-097e4001-7bf6-44c3-9982-4a521863ace3 tempest-AttachVolumeTestJSON-1453990575 None] Creating volume b5d26e94-6abd-4a0d-b4de-2c6c458265da {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:34:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-097e4001-7bf6-44c3-9982-4a521863ace3 tempest-AttachVolumeTestJSON-1453990575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:34:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-097e4001-7bf6-44c3-9982-4a521863ace3 tempest-AttachVolumeTestJSON-1453990575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:34:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-097e4001-7bf6-44c3-9982-4a521863ace3 tempest-AttachVolumeTestJSON-1453990575 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:34:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-097e4001-7bf6-44c3-9982-4a521863ace3 tempest-AttachVolumeTestJSON-1453990575 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:34:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-097e4001-7bf6-44c3-9982-4a521863ace3 tempest-AttachVolumeTestJSON-1453990575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:34:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-097e4001-7bf6-44c3-9982-4a521863ace3 tempest-AttachVolumeTestJSON-1453990575 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:34:13 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-097e4001-7bf6-44c3-9982-4a521863ace3 tempest-AttachVolumeTestJSON-1453990575 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:34:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-097e4001-7bf6-44c3-9982-4a521863ace3 tempest-AttachVolumeTestJSON-1453990575 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b5d26e94-6abd-4a0d-b4de-2c6c458265da 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:34:13 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 11:34:13 devstack quobyte-client[83193]: System call of process 87628 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:34:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:34:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:34:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:34:13 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=11, name=volume-b5d26e94-6abd-4a0d-b4de-2c6c458265da, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:34:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:34:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:34:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:34:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-097e4001-7bf6-44c3-9982-4a521863ace3 tempest-AttachVolumeTestJSON-1453990575 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b5d26e94-6abd-4a0d-b4de-2c6c458265da 1073741824" returned: 0 in 1.167s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:34:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-097e4001-7bf6-44c3-9982-4a521863ace3 tempest-AttachVolumeTestJSON-1453990575 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b5d26e94-6abd-4a0d-b4de-2c6c458265da {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:34:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.879s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:34:14 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:34:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-097e4001-7bf6-44c3-9982-4a521863ace3 tempest-AttachVolumeTestJSON-1453990575 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b5d26e94-6abd-4a0d-b4de-2c6c458265da" returned: 0 in 0.629s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:34:15 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-097e4001-7bf6-44c3-9982-4a521863ace3 tempest-AttachVolumeTestJSON-1453990575 None] <== create_volume: return (2032ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:34:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-097e4001-7bf6-44c3-9982-4a521863ace3 tempest-AttachVolumeTestJSON-1453990575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.065s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:34:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-097e4001-7bf6-44c3-9982-4a521863ace3 tempest-AttachVolumeTestJSON-1453990575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adb5cc3d-eb71-45bd-b890-b9e49d7f96e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5d26e94-6abd-4a0d-b4de-2c6c458265da', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:34:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-097e4001-7bf6-44c3-9982-4a521863ace3 tempest-AttachVolumeTestJSON-1453990575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c6e32d1-57c4-40c1-a88d-55fcf1fdd279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:34:16 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-097e4001-7bf6-44c3-9982-4a521863ace3 tempest-AttachVolumeTestJSON-1453990575 None] Volume volume-b5d26e94-6abd-4a0d-b4de-2c6c458265da (b5d26e94-6abd-4a0d-b4de-2c6c458265da): created successfully
Sep 18 11:34:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-097e4001-7bf6-44c3-9982-4a521863ace3 tempest-AttachVolumeTestJSON-1453990575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c6e32d1-57c4-40c1-a88d-55fcf1fdd279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:34:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-097e4001-7bf6-44c3-9982-4a521863ace3 tempest-AttachVolumeTestJSON-1453990575 None] Flow 'volume_create_manager' (5c74e8ec-a299-4ac8-90e6-d5824511c488) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:34:16 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-097e4001-7bf6-44c3-9982-4a521863ace3 tempest-AttachVolumeTestJSON-1453990575 None] Created volume successfully.
Sep 18 11:34:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-7061783d-f2e8-4d90-bb20-ab7e260ada94 req-df83f42b-6631-44a7-ab4c-1b346f56a3ee tempest-TaggedBootDevicesTest-1687567533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:34:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-7061783d-f2e8-4d90-bb20-ab7e260ada94 req-df83f42b-6631-44a7-ab4c-1b346f56a3ee tempest-TaggedBootDevicesTest-1687567533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:34:17 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[09907b9b-0866-42f1-b72d-9de42a02817d]: (4, 'raw') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:34:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-7061783d-f2e8-4d90-bb20-ab7e260ada94 req-df83f42b-6631-44a7-ab4c-1b346f56a3ee tempest-TaggedBootDevicesTest-1687567533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-aa0f4605-3d3e-4092-8d32-f88d3a202cc5 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:34:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-7061783d-f2e8-4d90-bb20-ab7e260ada94 req-df83f42b-6631-44a7-ab4c-1b346f56a3ee tempest-TaggedBootDevicesTest-1687567533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-aa0f4605-3d3e-4092-8d32-f88d3a202cc5" returned: 0 in 0.593s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:34:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-7061783d-f2e8-4d90-bb20-ab7e260ada94 req-df83f42b-6631-44a7-ab4c-1b346f56a3ee tempest-TaggedBootDevicesTest-1687567533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-aa0f4605-3d3e-4092-8d32-f88d3a202cc5 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:34:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-7061783d-f2e8-4d90-bb20-ab7e260ada94 req-df83f42b-6631-44a7-ab4c-1b346f56a3ee tempest-TaggedBootDevicesTest-1687567533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-aa0f4605-3d3e-4092-8d32-f88d3a202cc5" returned: 1 in 0.529s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:34:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-7061783d-f2e8-4d90-bb20-ab7e260ada94 req-df83f42b-6631-44a7-ab4c-1b346f56a3ee tempest-TaggedBootDevicesTest-1687567533 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-aa0f4605-3d3e-4092-8d32-f88d3a202cc5' failed. Not Retrying. {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 11:34:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-7061783d-f2e8-4d90-bb20-ab7e260ada94 req-df83f42b-6631-44a7-ab4c-1b346f56a3ee tempest-TaggedBootDevicesTest-1687567533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.304s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:34:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-7061783d-f2e8-4d90-bb20-ab7e260ada94 req-df83f42b-6631-44a7-ab4c-1b346f56a3ee tempest-TaggedBootDevicesTest-1687567533 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8', 'name': 'volume-aa0f4605-3d3e-4092-8d32-f88d3a202cc5', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ef838af5-fff5-440a-9676-1ab1c9eedc12', 'enforce_multipath': True} {{(pid=83176) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 11:34:19 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-7061783d-f2e8-4d90-bb20-ab7e260ada94 req-df83f42b-6631-44a7-ab4c-1b346f56a3ee tempest-TaggedBootDevicesTest-1687567533 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:34:19 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-7061783d-f2e8-4d90-bb20-ab7e260ada94 req-df83f42b-6631-44a7-ab4c-1b346f56a3ee tempest-TaggedBootDevicesTest-1687567533 None] attachment_update completed successfully.
Sep 18 11:34:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-f460ce13-5e64-4d34-a5b5-926a265cc657 req-144a9eef-dfc6-4407-9d4c-a3825cf3701a tempest-TaggedAttachmentsTest-2061971130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:34:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-f460ce13-5e64-4d34-a5b5-926a265cc657 req-144a9eef-dfc6-4407-9d4c-a3825cf3701a tempest-TaggedAttachmentsTest-2061971130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:34:20 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c716d90-bb82-46fb-baba-178e017d0671]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:34:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-f460ce13-5e64-4d34-a5b5-926a265cc657 req-144a9eef-dfc6-4407-9d4c-a3825cf3701a tempest-TaggedAttachmentsTest-2061971130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5c6e71b6-d133-4db5-af6d-f8929b802416 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:34:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-f460ce13-5e64-4d34-a5b5-926a265cc657 req-144a9eef-dfc6-4407-9d4c-a3825cf3701a tempest-TaggedAttachmentsTest-2061971130 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5c6e71b6-d133-4db5-af6d-f8929b802416" returned: 0 in 0.680s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:34:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-f460ce13-5e64-4d34-a5b5-926a265cc657 req-144a9eef-dfc6-4407-9d4c-a3825cf3701a tempest-TaggedAttachmentsTest-2061971130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.751s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:34:22 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-f460ce13-5e64-4d34-a5b5-926a265cc657 req-144a9eef-dfc6-4407-9d4c-a3825cf3701a tempest-TaggedAttachmentsTest-2061971130 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8', 'name': 'volume-5c6e71b6-d133-4db5-af6d-f8929b802416', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '06dcbb16-90e1-4944-b478-3e54e43e1eb1', 'enforce_multipath': True} {{(pid=83176) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 11:34:22 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-f460ce13-5e64-4d34-a5b5-926a265cc657 req-144a9eef-dfc6-4407-9d4c-a3825cf3701a tempest-TaggedAttachmentsTest-2061971130 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:34:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-9f7c5375-dca5-4feb-8736-2b97b27a396d req-7b5a16f7-3201-45cf-8b25-7164472102e2 tempest-AttachVolumeTestJSON-1453990575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:34:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-9f7c5375-dca5-4feb-8736-2b97b27a396d req-7b5a16f7-3201-45cf-8b25-7164472102e2 tempest-AttachVolumeTestJSON-1453990575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:34:22 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a394e85a-ad83-48e0-8b40-1b986210cd67]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:34:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-9f7c5375-dca5-4feb-8736-2b97b27a396d req-7b5a16f7-3201-45cf-8b25-7164472102e2 tempest-AttachVolumeTestJSON-1453990575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b5d26e94-6abd-4a0d-b4de-2c6c458265da {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:34:23 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-f460ce13-5e64-4d34-a5b5-926a265cc657 req-144a9eef-dfc6-4407-9d4c-a3825cf3701a tempest-TaggedAttachmentsTest-2061971130 None] attachment_update completed successfully.
Sep 18 11:34:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-9f7c5375-dca5-4feb-8736-2b97b27a396d req-7b5a16f7-3201-45cf-8b25-7164472102e2 tempest-AttachVolumeTestJSON-1453990575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b5d26e94-6abd-4a0d-b4de-2c6c458265da" returned: 0 in 0.723s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:34:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-9f7c5375-dca5-4feb-8736-2b97b27a396d req-7b5a16f7-3201-45cf-8b25-7164472102e2 tempest-AttachVolumeTestJSON-1453990575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.799s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:34:23 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-9f7c5375-dca5-4feb-8736-2b97b27a396d req-7b5a16f7-3201-45cf-8b25-7164472102e2 tempest-AttachVolumeTestJSON-1453990575 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8', 'name': 'volume-b5d26e94-6abd-4a0d-b4de-2c6c458265da', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '91be893a-6d31-4c99-bcc0-f20e59f59ccc', 'enforce_multipath': True} {{(pid=83176) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 11:34:23 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-9f7c5375-dca5-4feb-8736-2b97b27a396d req-7b5a16f7-3201-45cf-8b25-7164472102e2 tempest-AttachVolumeTestJSON-1453990575 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:34:23 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-9f7c5375-dca5-4feb-8736-2b97b27a396d req-7b5a16f7-3201-45cf-8b25-7164472102e2 tempest-AttachVolumeTestJSON-1453990575 None] attachment_update completed successfully.
Sep 18 11:34:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-7061783d-f2e8-4d90-bb20-ab7e260ada94 req-9b9909ff-7877-412e-921d-39c8d04e151a tempest-TaggedBootDevicesTest-1687567533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:34:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-7061783d-f2e8-4d90-bb20-ab7e260ada94 req-9b9909ff-7877-412e-921d-39c8d04e151a tempest-TaggedBootDevicesTest-1687567533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:34:23 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b265871-d483-41a3-ac7e-0049ec5a299c]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:34:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-7061783d-f2e8-4d90-bb20-ab7e260ada94 req-9b9909ff-7877-412e-921d-39c8d04e151a tempest-TaggedBootDevicesTest-1687567533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f79f2e6b-9bc6-431a-a74c-9c406afa1f8c {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:34:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-7061783d-f2e8-4d90-bb20-ab7e260ada94 req-9b9909ff-7877-412e-921d-39c8d04e151a tempest-TaggedBootDevicesTest-1687567533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f79f2e6b-9bc6-431a-a74c-9c406afa1f8c" returned: 0 in 0.807s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:34:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-7061783d-f2e8-4d90-bb20-ab7e260ada94 req-9b9909ff-7877-412e-921d-39c8d04e151a tempest-TaggedBootDevicesTest-1687567533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.891s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:34:25 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-7061783d-f2e8-4d90-bb20-ab7e260ada94 req-9b9909ff-7877-412e-921d-39c8d04e151a tempest-TaggedBootDevicesTest-1687567533 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8', 'name': 'volume-f79f2e6b-9bc6-431a-a74c-9c406afa1f8c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c91c3e5a-0b76-4390-8188-4fd51a53c666', 'enforce_multipath': True} {{(pid=83176) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 11:34:25 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-7061783d-f2e8-4d90-bb20-ab7e260ada94 req-9b9909ff-7877-412e-921d-39c8d04e151a tempest-TaggedBootDevicesTest-1687567533 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:34:25 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-7061783d-f2e8-4d90-bb20-ab7e260ada94 req-9b9909ff-7877-412e-921d-39c8d04e151a tempest-TaggedBootDevicesTest-1687567533 None] attachment_update completed successfully.
Sep 18 11:34:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-7061783d-f2e8-4d90-bb20-ab7e260ada94 req-a34a2ebd-13ea-4469-b585-c4ea72321b8c tempest-TaggedBootDevicesTest-1687567533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:34:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-7061783d-f2e8-4d90-bb20-ab7e260ada94 req-a34a2ebd-13ea-4469-b585-c4ea72321b8c tempest-TaggedBootDevicesTest-1687567533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:34:28 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa52d708-0883-44dd-9d2e-afbe6a5a6929]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:34:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-7061783d-f2e8-4d90-bb20-ab7e260ada94 req-a34a2ebd-13ea-4469-b585-c4ea72321b8c tempest-TaggedBootDevicesTest-1687567533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f9c8f419-a659-40bc-ae4f-c6c2caf8abf9 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:34:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-7061783d-f2e8-4d90-bb20-ab7e260ada94 req-a34a2ebd-13ea-4469-b585-c4ea72321b8c tempest-TaggedBootDevicesTest-1687567533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f9c8f419-a659-40bc-ae4f-c6c2caf8abf9" returned: 0 in 0.553s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:34:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-7061783d-f2e8-4d90-bb20-ab7e260ada94 req-a34a2ebd-13ea-4469-b585-c4ea72321b8c tempest-TaggedBootDevicesTest-1687567533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.677s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:34:29 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-7061783d-f2e8-4d90-bb20-ab7e260ada94 req-a34a2ebd-13ea-4469-b585-c4ea72321b8c tempest-TaggedBootDevicesTest-1687567533 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8', 'name': 'volume-f9c8f419-a659-40bc-ae4f-c6c2caf8abf9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1091ab78-53cb-482a-987a-1474f90ad25d', 'enforce_multipath': True} {{(pid=83176) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 11:34:29 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-7061783d-f2e8-4d90-bb20-ab7e260ada94 req-a34a2ebd-13ea-4469-b585-c4ea72321b8c tempest-TaggedBootDevicesTest-1687567533 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:34:29 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-7061783d-f2e8-4d90-bb20-ab7e260ada94 req-a34a2ebd-13ea-4469-b585-c4ea72321b8c tempest-TaggedBootDevicesTest-1687567533 None] attachment_update completed successfully.
Sep 18 11:34:32 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-0daf2d3d-dcb4-4b91-9273-9436ca74fa5f tempest-AttachVolumeTestJSON-1453990575 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:34:32 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-0daf2d3d-dcb4-4b91-9273-9436ca74fa5f tempest-AttachVolumeTestJSON-1453990575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:34:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0daf2d3d-dcb4-4b91-9273-9436ca74fa5f tempest-AttachVolumeTestJSON-1453990575 None] Flow 'volume_create_manager' (762f439f-b1a1-4c43-866c-21a56b04225d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:34:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0daf2d3d-dcb4-4b91-9273-9436ca74fa5f tempest-AttachVolumeTestJSON-1453990575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (138140bb-b28f-4f57-93f8-00dbf2cb26b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:34:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0daf2d3d-dcb4-4b91-9273-9436ca74fa5f tempest-AttachVolumeTestJSON-1453990575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (138140bb-b28f-4f57-93f8-00dbf2cb26b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-114803985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83c2a64a-b16f-4319-b230-a6279a1da13c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a8a837e06b4e66ae9eee5d6b4ead52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:34:32Z,use_quota=True,user_id='af8eee920c034ce78c561706f3fec005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:34:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0daf2d3d-dcb4-4b91-9273-9436ca74fa5f tempest-AttachVolumeTestJSON-1453990575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39eea170-f081-4990-8327-aeb9d59472b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:34:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0daf2d3d-dcb4-4b91-9273-9436ca74fa5f tempest-AttachVolumeTestJSON-1453990575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39eea170-f081-4990-8327-aeb9d59472b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:34:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0daf2d3d-dcb4-4b91-9273-9436ca74fa5f tempest-AttachVolumeTestJSON-1453990575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b994e89f-b9aa-46fb-9702-b93d2efded01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:34:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0daf2d3d-dcb4-4b91-9273-9436ca74fa5f tempest-AttachVolumeTestJSON-1453990575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b994e89f-b9aa-46fb-9702-b93d2efded01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83c2a64a-b16f-4319-b230-a6279a1da13c', 'volume_name': 'volume-83c2a64a-b16f-4319-b230-a6279a1da13c', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:34:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0daf2d3d-dcb4-4b91-9273-9436ca74fa5f tempest-AttachVolumeTestJSON-1453990575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb03a1c-7837-4734-8a6a-697db8027f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:34:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0daf2d3d-dcb4-4b91-9273-9436ca74fa5f tempest-AttachVolumeTestJSON-1453990575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb03a1c-7837-4734-8a6a-697db8027f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:34:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0daf2d3d-dcb4-4b91-9273-9436ca74fa5f tempest-AttachVolumeTestJSON-1453990575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26fe8a9a-8230-4c38-aed6-54f26da22984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:34:32 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-0daf2d3d-dcb4-4b91-9273-9436ca74fa5f tempest-AttachVolumeTestJSON-1453990575 None] Volume 83c2a64a-b16f-4319-b230-a6279a1da13c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83c2a64a-b16f-4319-b230-a6279a1da13c', 'volume_size': 1}
Sep 18 11:34:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0daf2d3d-dcb4-4b91-9273-9436ca74fa5f tempest-AttachVolumeTestJSON-1453990575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:34:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0daf2d3d-dcb4-4b91-9273-9436ca74fa5f tempest-AttachVolumeTestJSON-1453990575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:34:32 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-0daf2d3d-dcb4-4b91-9273-9436ca74fa5f tempest-AttachVolumeTestJSON-1453990575 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-114803985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83c2a64a-b16f-4319-b230-a6279a1da13c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a8a837e06b4e66ae9eee5d6b4ead52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:34:32Z,use_quota=True,user_id='af8eee920c034ce78c561706f3fec005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:34:32 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-0daf2d3d-dcb4-4b91-9273-9436ca74fa5f tempest-AttachVolumeTestJSON-1453990575 None] Creating volume 83c2a64a-b16f-4319-b230-a6279a1da13c {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:34:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0daf2d3d-dcb4-4b91-9273-9436ca74fa5f tempest-AttachVolumeTestJSON-1453990575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:34:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0daf2d3d-dcb4-4b91-9273-9436ca74fa5f tempest-AttachVolumeTestJSON-1453990575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:34:32 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-0daf2d3d-dcb4-4b91-9273-9436ca74fa5f tempest-AttachVolumeTestJSON-1453990575 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:34:32 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-0daf2d3d-dcb4-4b91-9273-9436ca74fa5f tempest-AttachVolumeTestJSON-1453990575 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:34:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0daf2d3d-dcb4-4b91-9273-9436ca74fa5f tempest-AttachVolumeTestJSON-1453990575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:34:32 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-0daf2d3d-dcb4-4b91-9273-9436ca74fa5f tempest-AttachVolumeTestJSON-1453990575 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:34:32 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-0daf2d3d-dcb4-4b91-9273-9436ca74fa5f tempest-AttachVolumeTestJSON-1453990575 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:34:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0daf2d3d-dcb4-4b91-9273-9436ca74fa5f tempest-AttachVolumeTestJSON-1453990575 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-83c2a64a-b16f-4319-b230-a6279a1da13c 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:34:32 devstack quobyte-client[83193]: System call of process 88129 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:34:32 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=12, name=volume-83c2a64a-b16f-4319-b230-a6279a1da13c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:34:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0daf2d3d-dcb4-4b91-9273-9436ca74fa5f tempest-AttachVolumeTestJSON-1453990575 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-83c2a64a-b16f-4319-b230-a6279a1da13c 1073741824" returned: 0 in 0.536s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:34:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0daf2d3d-dcb4-4b91-9273-9436ca74fa5f tempest-AttachVolumeTestJSON-1453990575 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-83c2a64a-b16f-4319-b230-a6279a1da13c {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:34:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0daf2d3d-dcb4-4b91-9273-9436ca74fa5f tempest-AttachVolumeTestJSON-1453990575 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-83c2a64a-b16f-4319-b230-a6279a1da13c" returned: 0 in 0.600s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:34:33 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-0daf2d3d-dcb4-4b91-9273-9436ca74fa5f tempest-AttachVolumeTestJSON-1453990575 None] <== create_volume: return (1352ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:34:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0daf2d3d-dcb4-4b91-9273-9436ca74fa5f tempest-AttachVolumeTestJSON-1453990575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.361s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:34:34 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0daf2d3d-dcb4-4b91-9273-9436ca74fa5f tempest-AttachVolumeTestJSON-1453990575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26fe8a9a-8230-4c38-aed6-54f26da22984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83c2a64a-b16f-4319-b230-a6279a1da13c', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:34:34 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0daf2d3d-dcb4-4b91-9273-9436ca74fa5f tempest-AttachVolumeTestJSON-1453990575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3114cd92-7b8b-41d5-9a3d-37651d71b3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:34:34 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-0daf2d3d-dcb4-4b91-9273-9436ca74fa5f tempest-AttachVolumeTestJSON-1453990575 None] Volume volume-83c2a64a-b16f-4319-b230-a6279a1da13c (83c2a64a-b16f-4319-b230-a6279a1da13c): created successfully
Sep 18 11:34:34 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0daf2d3d-dcb4-4b91-9273-9436ca74fa5f tempest-AttachVolumeTestJSON-1453990575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3114cd92-7b8b-41d5-9a3d-37651d71b3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:34:34 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0daf2d3d-dcb4-4b91-9273-9436ca74fa5f tempest-AttachVolumeTestJSON-1453990575 None] Flow 'volume_create_manager' (762f439f-b1a1-4c43-866c-21a56b04225d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:34:34 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-0daf2d3d-dcb4-4b91-9273-9436ca74fa5f tempest-AttachVolumeTestJSON-1453990575 None] Created volume successfully.
Sep 18 11:34:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-430e3de4-7973-4654-8a4a-625d50243818 req-6019a884-ef13-4622-abe1-631251a3f99b tempest-AttachVolumeTestJSON-1453990575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:34:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-430e3de4-7973-4654-8a4a-625d50243818 req-6019a884-ef13-4622-abe1-631251a3f99b tempest-AttachVolumeTestJSON-1453990575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:34:38 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4c5929-527a-49aa-b17f-dbb11728d507]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:34:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-430e3de4-7973-4654-8a4a-625d50243818 req-6019a884-ef13-4622-abe1-631251a3f99b tempest-AttachVolumeTestJSON-1453990575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-83c2a64a-b16f-4319-b230-a6279a1da13c {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:34:39 devstack quobyte-client[83193]: System call of process 88149 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:34:39 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-430e3de4-7973-4654-8a4a-625d50243818 req-6019a884-ef13-4622-abe1-631251a3f99b tempest-AttachVolumeTestJSON-1453990575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-83c2a64a-b16f-4319-b230-a6279a1da13c" returned: 0 in 0.461s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:34:39 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-430e3de4-7973-4654-8a4a-625d50243818 req-6019a884-ef13-4622-abe1-631251a3f99b tempest-AttachVolumeTestJSON-1453990575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.544s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:34:39 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-430e3de4-7973-4654-8a4a-625d50243818 req-6019a884-ef13-4622-abe1-631251a3f99b tempest-AttachVolumeTestJSON-1453990575 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8', 'name': 'volume-83c2a64a-b16f-4319-b230-a6279a1da13c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e8fe4b91-44bc-4ce2-8a18-b719117423b0', 'enforce_multipath': True} {{(pid=83176) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 11:34:39 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-430e3de4-7973-4654-8a4a-625d50243818 req-6019a884-ef13-4622-abe1-631251a3f99b tempest-AttachVolumeTestJSON-1453990575 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:34:39 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-430e3de4-7973-4654-8a4a-625d50243818 req-6019a884-ef13-4622-abe1-631251a3f99b tempest-AttachVolumeTestJSON-1453990575 None] attachment_update completed successfully.
Sep 18 11:34:49 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:UPDATE=13,cinder:SELECT=36 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:34:49 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=35,cinder:UPDATE=14,cinder:DELETE=2 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:34:58 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-3039c8c9-be6b-4ffe-bf14-f9b0b0c3fdcf req-5da3bd2c-94e0-4718-8e86-703550e63053 tempest-TaggedAttachmentsTest-2061971130 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:34:58 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-3039c8c9-be6b-4ffe-bf14-f9b0b0c3fdcf req-5da3bd2c-94e0-4718-8e86-703550e63053 tempest-TaggedAttachmentsTest-2061971130 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:34:58 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-3039c8c9-be6b-4ffe-bf14-f9b0b0c3fdcf req-5da3bd2c-94e0-4718-8e86-703550e63053 tempest-TaggedAttachmentsTest-2061971130 None] Terminate volume connection completed successfully.
Sep 18 11:34:58 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-3039c8c9-be6b-4ffe-bf14-f9b0b0c3fdcf req-5da3bd2c-94e0-4718-8e86-703550e63053 tempest-TaggedAttachmentsTest-2061971130 None] Deleting attachment 06dcbb16-90e1-4944-b478-3e54e43e1eb1. {{(pid=83176) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 11:35:07 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-43d6b54c-5348-4ca9-a984-fc4f246662e9 req-4a85548a-f71b-4b38-a813-0984b1b382c3 tempest-AttachVolumeTestJSON-1453990575 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:35:07 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-43d6b54c-5348-4ca9-a984-fc4f246662e9 req-4a85548a-f71b-4b38-a813-0984b1b382c3 tempest-AttachVolumeTestJSON-1453990575 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:35:07 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-43d6b54c-5348-4ca9-a984-fc4f246662e9 req-4a85548a-f71b-4b38-a813-0984b1b382c3 tempest-AttachVolumeTestJSON-1453990575 None] Terminate volume connection completed successfully.
Sep 18 11:35:07 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-43d6b54c-5348-4ca9-a984-fc4f246662e9 req-4a85548a-f71b-4b38-a813-0984b1b382c3 tempest-AttachVolumeTestJSON-1453990575 None] Deleting attachment 91be893a-6d31-4c99-bcc0-f20e59f59ccc. {{(pid=83176) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 11:35:13 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 11:35:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:35:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:35:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:35:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:35:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.053s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:35:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:35:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.197s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:35:13 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:35:17 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=2 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:35:17 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=2 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:35:34 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-9dd148d1-24a8-4841-8c1f-fc901d88bd8b req-7e0e666e-0fb6-41f3-b061-0c5ae74cf173 tempest-AttachVolumeTestJSON-1453990575 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:35:35 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-9dd148d1-24a8-4841-8c1f-fc901d88bd8b req-7e0e666e-0fb6-41f3-b061-0c5ae74cf173 tempest-AttachVolumeTestJSON-1453990575 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:35:35 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-9dd148d1-24a8-4841-8c1f-fc901d88bd8b req-7e0e666e-0fb6-41f3-b061-0c5ae74cf173 tempest-AttachVolumeTestJSON-1453990575 None] Terminate volume connection completed successfully.
Sep 18 11:35:35 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-9dd148d1-24a8-4841-8c1f-fc901d88bd8b req-7e0e666e-0fb6-41f3-b061-0c5ae74cf173 tempest-AttachVolumeTestJSON-1453990575 None] Deleting attachment e8fe4b91-44bc-4ce2-8a18-b719117423b0. {{(pid=83176) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 11:35:45 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=2 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:35:53 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f64091c2-d3ab-43a6-80b6-685abd117960 tempest-TaggedAttachmentsTest-2061971130 None] Acquiring lock "cinder-5c6e71b6-d133-4db5-af6d-f8929b802416-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:35:53 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f64091c2-d3ab-43a6-80b6-685abd117960 tempest-TaggedAttachmentsTest-2061971130 None] Lock "cinder-5c6e71b6-d133-4db5-af6d-f8929b802416-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:35:53 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-f64091c2-d3ab-43a6-80b6-685abd117960 tempest-TaggedAttachmentsTest-2061971130 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:35:53 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f64091c2-d3ab-43a6-80b6-685abd117960 tempest-TaggedAttachmentsTest-2061971130 None] Acquiring lock "cinder-quobyte-5c6e71b6-d133-4db5-af6d-f8929b802416" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:35:53 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f64091c2-d3ab-43a6-80b6-685abd117960 tempest-TaggedAttachmentsTest-2061971130 None] Lock "cinder-quobyte-5c6e71b6-d133-4db5-af6d-f8929b802416" acquired by "delete_volume" :: waited 0.016s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:35:53 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5cf36e-dcd6-4f63-9e34-ca52580f04a5]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:35:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f64091c2-d3ab-43a6-80b6-685abd117960 tempest-TaggedAttachmentsTest-2061971130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5c6e71b6-d133-4db5-af6d-f8929b802416 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:35:54 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f002e4de-0e66-4418-b4ad-083d78340ccc tempest-AttachVolumeTestJSON-1453990575 None] Acquiring lock "cinder-83c2a64a-b16f-4319-b230-a6279a1da13c-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:35:54 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f002e4de-0e66-4418-b4ad-083d78340ccc tempest-AttachVolumeTestJSON-1453990575 None] Lock "cinder-83c2a64a-b16f-4319-b230-a6279a1da13c-delete_volume" acquired by "delete_volume" :: waited 0.131s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:35:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f64091c2-d3ab-43a6-80b6-685abd117960 tempest-TaggedAttachmentsTest-2061971130 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5c6e71b6-d133-4db5-af6d-f8929b802416" returned: 0 in 0.851s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:35:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f64091c2-d3ab-43a6-80b6-685abd117960 tempest-TaggedAttachmentsTest-2061971130 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5c6e71b6-d133-4db5-af6d-f8929b802416 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:35:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f64091c2-d3ab-43a6-80b6-685abd117960 tempest-TaggedAttachmentsTest-2061971130 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5c6e71b6-d133-4db5-af6d-f8929b802416" returned: 0 in 0.342s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:35:54 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-f002e4de-0e66-4418-b4ad-083d78340ccc tempest-AttachVolumeTestJSON-1453990575 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:35:54 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f002e4de-0e66-4418-b4ad-083d78340ccc tempest-AttachVolumeTestJSON-1453990575 None] Acquiring lock "cinder-quobyte-83c2a64a-b16f-4319-b230-a6279a1da13c" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:35:54 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f64091c2-d3ab-43a6-80b6-685abd117960 tempest-TaggedAttachmentsTest-2061971130 None] Lock "cinder-quobyte-5c6e71b6-d133-4db5-af6d-f8929b802416" released by "delete_volume" :: held 1.394s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:35:55 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f002e4de-0e66-4418-b4ad-083d78340ccc tempest-AttachVolumeTestJSON-1453990575 None] Lock "cinder-quobyte-83c2a64a-b16f-4319-b230-a6279a1da13c" acquired by "delete_volume" :: waited 0.050s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:35:55 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[369f6a8b-922a-4a1e-82d1-e7ea6d89a6ae]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:35:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f002e4de-0e66-4418-b4ad-083d78340ccc tempest-AttachVolumeTestJSON-1453990575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-83c2a64a-b16f-4319-b230-a6279a1da13c {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:35:55 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-f64091c2-d3ab-43a6-80b6-685abd117960 tempest-TaggedAttachmentsTest-2061971130 None] Created reservations ['6320aee5-664b-4b15-8460-fbd2e4f357c4', 'd54dbf9d-12c0-4ac2-83e3-e39ddde88e98', '0c27cdb5-8648-4353-bdb2-d1ec49c70b86', 'f87a0c65-190f-46e2-ae69-50753eef9d9f'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:35:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f64091c2-d3ab-43a6-80b6-685abd117960 tempest-TaggedAttachmentsTest-2061971130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:35:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f64091c2-d3ab-43a6-80b6-685abd117960 tempest-TaggedAttachmentsTest-2061971130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:35:55 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f64091c2-d3ab-43a6-80b6-685abd117960 tempest-TaggedAttachmentsTest-2061971130 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:35:55 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f64091c2-d3ab-43a6-80b6-685abd117960 tempest-TaggedAttachmentsTest-2061971130 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:35:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f64091c2-d3ab-43a6-80b6-685abd117960 tempest-TaggedAttachmentsTest-2061971130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:35:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f64091c2-d3ab-43a6-80b6-685abd117960 tempest-TaggedAttachmentsTest-2061971130 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:35:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f002e4de-0e66-4418-b4ad-083d78340ccc tempest-AttachVolumeTestJSON-1453990575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-83c2a64a-b16f-4319-b230-a6279a1da13c" returned: 0 in 0.895s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:35:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f002e4de-0e66-4418-b4ad-083d78340ccc tempest-AttachVolumeTestJSON-1453990575 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-83c2a64a-b16f-4319-b230-a6279a1da13c {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:35:56 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f64091c2-d3ab-43a6-80b6-685abd117960 tempest-TaggedAttachmentsTest-2061971130 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.321s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:35:56 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-f64091c2-d3ab-43a6-80b6-685abd117960 tempest-TaggedAttachmentsTest-2061971130 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:35:56 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-f64091c2-d3ab-43a6-80b6-685abd117960 tempest-TaggedAttachmentsTest-2061971130 None] Deleted volume successfully.
Sep 18 11:35:56 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f002e4de-0e66-4418-b4ad-083d78340ccc tempest-AttachVolumeTestJSON-1453990575 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-83c2a64a-b16f-4319-b230-a6279a1da13c" returned: 0 in 0.377s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:35:56 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f64091c2-d3ab-43a6-80b6-685abd117960 tempest-TaggedAttachmentsTest-2061971130 None] Lock "cinder-5c6e71b6-d133-4db5-af6d-f8929b802416-delete_volume" released by "delete_volume" :: held 3.015s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:35:56 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f002e4de-0e66-4418-b4ad-083d78340ccc tempest-AttachVolumeTestJSON-1453990575 None] Lock "cinder-quobyte-83c2a64a-b16f-4319-b230-a6279a1da13c" released by "delete_volume" :: held 1.435s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:35:56 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-f002e4de-0e66-4418-b4ad-083d78340ccc tempest-AttachVolumeTestJSON-1453990575 None] Created reservations ['86d3f61e-c287-4c82-a31f-128bd2b33e4f', '4ba10ced-5783-4ca5-8219-dcce1cf6d3a9', '7f4ac452-fb78-46f8-8948-63813ead5333', 'f98defeb-1f5b-4298-8a3d-dae232f8d561'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:35:56 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f002e4de-0e66-4418-b4ad-083d78340ccc tempest-AttachVolumeTestJSON-1453990575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:35:56 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f002e4de-0e66-4418-b4ad-083d78340ccc tempest-AttachVolumeTestJSON-1453990575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:35:56 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f002e4de-0e66-4418-b4ad-083d78340ccc tempest-AttachVolumeTestJSON-1453990575 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:35:56 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f002e4de-0e66-4418-b4ad-083d78340ccc tempest-AttachVolumeTestJSON-1453990575 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:35:56 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f002e4de-0e66-4418-b4ad-083d78340ccc tempest-AttachVolumeTestJSON-1453990575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:35:56 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f002e4de-0e66-4418-b4ad-083d78340ccc tempest-AttachVolumeTestJSON-1453990575 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:35:56 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f002e4de-0e66-4418-b4ad-083d78340ccc tempest-AttachVolumeTestJSON-1453990575 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.114s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:35:56 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-f002e4de-0e66-4418-b4ad-083d78340ccc tempest-AttachVolumeTestJSON-1453990575 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:35:57 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-f002e4de-0e66-4418-b4ad-083d78340ccc tempest-AttachVolumeTestJSON-1453990575 None] Deleted volume successfully.
Sep 18 11:35:57 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f002e4de-0e66-4418-b4ad-083d78340ccc tempest-AttachVolumeTestJSON-1453990575 None] Lock "cinder-83c2a64a-b16f-4319-b230-a6279a1da13c-delete_volume" released by "delete_volume" :: held 2.889s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:35:57 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-870e988d-0e4f-49b4-9ea1-809acf69ce8d tempest-AttachVolumeTestJSON-1453990575 None] Acquiring lock "cinder-b5d26e94-6abd-4a0d-b4de-2c6c458265da-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:35:57 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-870e988d-0e4f-49b4-9ea1-809acf69ce8d tempest-AttachVolumeTestJSON-1453990575 None] Lock "cinder-b5d26e94-6abd-4a0d-b4de-2c6c458265da-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:35:57 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-870e988d-0e4f-49b4-9ea1-809acf69ce8d tempest-AttachVolumeTestJSON-1453990575 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:35:57 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-870e988d-0e4f-49b4-9ea1-809acf69ce8d tempest-AttachVolumeTestJSON-1453990575 None] Acquiring lock "cinder-quobyte-b5d26e94-6abd-4a0d-b4de-2c6c458265da" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:35:57 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-870e988d-0e4f-49b4-9ea1-809acf69ce8d tempest-AttachVolumeTestJSON-1453990575 None] Lock "cinder-quobyte-b5d26e94-6abd-4a0d-b4de-2c6c458265da" acquired by "delete_volume" :: waited 0.017s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:35:57 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d461805-b6e3-4179-9ee0-51e4559d25aa]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:35:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-870e988d-0e4f-49b4-9ea1-809acf69ce8d tempest-AttachVolumeTestJSON-1453990575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b5d26e94-6abd-4a0d-b4de-2c6c458265da {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:35:58 devstack quobyte-client[83193]: System call of process 88959 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:35:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-870e988d-0e4f-49b4-9ea1-809acf69ce8d tempest-AttachVolumeTestJSON-1453990575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b5d26e94-6abd-4a0d-b4de-2c6c458265da" returned: 0 in 0.616s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:35:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-870e988d-0e4f-49b4-9ea1-809acf69ce8d tempest-AttachVolumeTestJSON-1453990575 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b5d26e94-6abd-4a0d-b4de-2c6c458265da {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:35:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-870e988d-0e4f-49b4-9ea1-809acf69ce8d tempest-AttachVolumeTestJSON-1453990575 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b5d26e94-6abd-4a0d-b4de-2c6c458265da" returned: 0 in 0.210s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:35:59 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-870e988d-0e4f-49b4-9ea1-809acf69ce8d tempest-AttachVolumeTestJSON-1453990575 None] Lock "cinder-quobyte-b5d26e94-6abd-4a0d-b4de-2c6c458265da" released by "delete_volume" :: held 1.204s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:35:59 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-870e988d-0e4f-49b4-9ea1-809acf69ce8d tempest-AttachVolumeTestJSON-1453990575 None] Created reservations ['5001e26b-d465-4fe1-83fd-30c02c3a1033', '5d0112b7-8de0-4d96-8ad6-e4d443f9809f', '1af539ee-231a-4694-b230-6327e6558548', '5525e82a-5f3d-4cc3-92e9-f9f1d514a58b'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:35:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-870e988d-0e4f-49b4-9ea1-809acf69ce8d tempest-AttachVolumeTestJSON-1453990575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:35:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-870e988d-0e4f-49b4-9ea1-809acf69ce8d tempest-AttachVolumeTestJSON-1453990575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:35:59 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-870e988d-0e4f-49b4-9ea1-809acf69ce8d tempest-AttachVolumeTestJSON-1453990575 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:35:59 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-870e988d-0e4f-49b4-9ea1-809acf69ce8d tempest-AttachVolumeTestJSON-1453990575 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:35:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-870e988d-0e4f-49b4-9ea1-809acf69ce8d tempest-AttachVolumeTestJSON-1453990575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:35:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-870e988d-0e4f-49b4-9ea1-809acf69ce8d tempest-AttachVolumeTestJSON-1453990575 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:36:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-870e988d-0e4f-49b4-9ea1-809acf69ce8d tempest-AttachVolumeTestJSON-1453990575 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.187s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:36:00 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-870e988d-0e4f-49b4-9ea1-809acf69ce8d tempest-AttachVolumeTestJSON-1453990575 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:36:00 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-870e988d-0e4f-49b4-9ea1-809acf69ce8d tempest-AttachVolumeTestJSON-1453990575 None] Deleted volume successfully.
Sep 18 11:36:00 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-41bb89f2-f2a4-4719-b3dd-ca295981fcda tempest-AttachVolumeTestJSON-1453990575 None] Acquiring lock "cinder-74cf6b74-0ac1-4d0d-9958-650a0b66114d-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:36:00 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-41bb89f2-f2a4-4719-b3dd-ca295981fcda tempest-AttachVolumeTestJSON-1453990575 None] Lock "cinder-74cf6b74-0ac1-4d0d-9958-650a0b66114d-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:36:00 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-870e988d-0e4f-49b4-9ea1-809acf69ce8d tempest-AttachVolumeTestJSON-1453990575 None] Lock "cinder-b5d26e94-6abd-4a0d-b4de-2c6c458265da-delete_volume" released by "delete_volume" :: held 2.779s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:36:00 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-41bb89f2-f2a4-4719-b3dd-ca295981fcda tempest-AttachVolumeTestJSON-1453990575 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:36:00 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-41bb89f2-f2a4-4719-b3dd-ca295981fcda tempest-AttachVolumeTestJSON-1453990575 None] Acquiring lock "cinder-quobyte-74cf6b74-0ac1-4d0d-9958-650a0b66114d" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:36:00 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-41bb89f2-f2a4-4719-b3dd-ca295981fcda tempest-AttachVolumeTestJSON-1453990575 None] Lock "cinder-quobyte-74cf6b74-0ac1-4d0d-9958-650a0b66114d" acquired by "delete_volume" :: waited 0.011s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:36:00 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3caf403-7b24-4fce-8937-224cdbbce89e]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:36:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-41bb89f2-f2a4-4719-b3dd-ca295981fcda tempest-AttachVolumeTestJSON-1453990575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-74cf6b74-0ac1-4d0d-9958-650a0b66114d {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:36:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-41bb89f2-f2a4-4719-b3dd-ca295981fcda tempest-AttachVolumeTestJSON-1453990575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-74cf6b74-0ac1-4d0d-9958-650a0b66114d" returned: 0 in 0.701s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:36:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-41bb89f2-f2a4-4719-b3dd-ca295981fcda tempest-AttachVolumeTestJSON-1453990575 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-74cf6b74-0ac1-4d0d-9958-650a0b66114d {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:36:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-41bb89f2-f2a4-4719-b3dd-ca295981fcda tempest-AttachVolumeTestJSON-1453990575 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-74cf6b74-0ac1-4d0d-9958-650a0b66114d" returned: 0 in 0.144s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:36:01 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-41bb89f2-f2a4-4719-b3dd-ca295981fcda tempest-AttachVolumeTestJSON-1453990575 None] Lock "cinder-quobyte-74cf6b74-0ac1-4d0d-9958-650a0b66114d" released by "delete_volume" :: held 1.037s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:36:02 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-41bb89f2-f2a4-4719-b3dd-ca295981fcda tempest-AttachVolumeTestJSON-1453990575 None] Created reservations ['0089fdd0-25b2-4309-906b-81867fbad711', '55716a7a-65d6-4d52-bf4f-083782118746', '9022c5b8-56db-40de-99a3-22428ca40b36', 'fb94edc7-ef2b-41b4-a12d-5baa26f3d360'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:36:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-41bb89f2-f2a4-4719-b3dd-ca295981fcda tempest-AttachVolumeTestJSON-1453990575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:36:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-41bb89f2-f2a4-4719-b3dd-ca295981fcda tempest-AttachVolumeTestJSON-1453990575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:36:02 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-41bb89f2-f2a4-4719-b3dd-ca295981fcda tempest-AttachVolumeTestJSON-1453990575 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:36:02 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-41bb89f2-f2a4-4719-b3dd-ca295981fcda tempest-AttachVolumeTestJSON-1453990575 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:36:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-41bb89f2-f2a4-4719-b3dd-ca295981fcda tempest-AttachVolumeTestJSON-1453990575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:36:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-41bb89f2-f2a4-4719-b3dd-ca295981fcda tempest-AttachVolumeTestJSON-1453990575 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:36:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-41bb89f2-f2a4-4719-b3dd-ca295981fcda tempest-AttachVolumeTestJSON-1453990575 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.170s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:36:02 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-41bb89f2-f2a4-4719-b3dd-ca295981fcda tempest-AttachVolumeTestJSON-1453990575 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:36:02 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-41bb89f2-f2a4-4719-b3dd-ca295981fcda tempest-AttachVolumeTestJSON-1453990575 None] Deleted volume successfully.
Sep 18 11:36:03 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-41bb89f2-f2a4-4719-b3dd-ca295981fcda tempest-AttachVolumeTestJSON-1453990575 None] Lock "cinder-74cf6b74-0ac1-4d0d-9958-650a0b66114d-delete_volume" released by "delete_volume" :: held 2.594s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:36:12 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=19,cinder:UPDATE=32,cinder:INSERT=11 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:36:12 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:UPDATE=32,cinder:SELECT=21,cinder:DELETE=4,cinder:INSERT=5 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:36:13 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 11:36:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:36:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:36:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:36:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:36:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:36:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:36:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.212s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:36:13 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:36:21 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-069cf8d1-24ad-4ce8-b173-949a255d1efc req-89084515-95cc-49e7-9629-3ce390599ce6 tempest-VolumesGetTestJSON-747977406 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:36:21 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [req-069cf8d1-24ad-4ce8-b173-949a255d1efc req-89084515-95cc-49e7-9629-3ce390599ce6 tempest-VolumesGetTestJSON-747977406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:36:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-069cf8d1-24ad-4ce8-b173-949a255d1efc req-89084515-95cc-49e7-9629-3ce390599ce6 tempest-VolumesGetTestJSON-747977406 None] Flow 'volume_create_manager' (85976fb7-48da-46b0-888b-cdd58483a5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:36:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-069cf8d1-24ad-4ce8-b173-949a255d1efc req-89084515-95cc-49e7-9629-3ce390599ce6 tempest-VolumesGetTestJSON-747977406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (398d91f7-c898-43b3-b766-51bb950b79f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:36:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-069cf8d1-24ad-4ce8-b173-949a255d1efc req-89084515-95cc-49e7-9629-3ce390599ce6 tempest-VolumesGetTestJSON-747977406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (398d91f7-c898-43b3-b766-51bb950b79f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-517498459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82be5160-abcb-4fa8-aca1-feb76b83fd82,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e10538ebd2fd4d2bbf7cf9be18d5bf4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:36:21Z,use_quota=True,user_id='4ceb8ccadf5841b685db644f1253c5a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:36:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-069cf8d1-24ad-4ce8-b173-949a255d1efc req-89084515-95cc-49e7-9629-3ce390599ce6 tempest-VolumesGetTestJSON-747977406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efeb9d3b-4ecd-4004-af74-a938683c36fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:36:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-069cf8d1-24ad-4ce8-b173-949a255d1efc req-89084515-95cc-49e7-9629-3ce390599ce6 tempest-VolumesGetTestJSON-747977406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efeb9d3b-4ecd-4004-af74-a938683c36fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:36:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-069cf8d1-24ad-4ce8-b173-949a255d1efc req-89084515-95cc-49e7-9629-3ce390599ce6 tempest-VolumesGetTestJSON-747977406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfdc6ef4-b09e-40e0-b668-1a90fe28fb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:36:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-069cf8d1-24ad-4ce8-b173-949a255d1efc req-89084515-95cc-49e7-9629-3ce390599ce6 tempest-VolumesGetTestJSON-747977406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfdc6ef4-b09e-40e0-b668-1a90fe28fb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82be5160-abcb-4fa8-aca1-feb76b83fd82', 'volume_name': 'volume-82be5160-abcb-4fa8-aca1-feb76b83fd82', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:36:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-069cf8d1-24ad-4ce8-b173-949a255d1efc req-89084515-95cc-49e7-9629-3ce390599ce6 tempest-VolumesGetTestJSON-747977406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2597b703-81c6-4d86-851b-96086b3da109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:36:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-069cf8d1-24ad-4ce8-b173-949a255d1efc req-89084515-95cc-49e7-9629-3ce390599ce6 tempest-VolumesGetTestJSON-747977406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2597b703-81c6-4d86-851b-96086b3da109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:36:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-069cf8d1-24ad-4ce8-b173-949a255d1efc req-89084515-95cc-49e7-9629-3ce390599ce6 tempest-VolumesGetTestJSON-747977406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a531da4c-a4fd-4fb2-90a8-d68642fca099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:36:21 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [req-069cf8d1-24ad-4ce8-b173-949a255d1efc req-89084515-95cc-49e7-9629-3ce390599ce6 tempest-VolumesGetTestJSON-747977406 None] Volume 82be5160-abcb-4fa8-aca1-feb76b83fd82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82be5160-abcb-4fa8-aca1-feb76b83fd82', 'volume_size': 1}
Sep 18 11:36:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-069cf8d1-24ad-4ce8-b173-949a255d1efc req-89084515-95cc-49e7-9629-3ce390599ce6 tempest-VolumesGetTestJSON-747977406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:36:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-069cf8d1-24ad-4ce8-b173-949a255d1efc req-89084515-95cc-49e7-9629-3ce390599ce6 tempest-VolumesGetTestJSON-747977406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:36:21 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [req-069cf8d1-24ad-4ce8-b173-949a255d1efc req-89084515-95cc-49e7-9629-3ce390599ce6 tempest-VolumesGetTestJSON-747977406 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-517498459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82be5160-abcb-4fa8-aca1-feb76b83fd82,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e10538ebd2fd4d2bbf7cf9be18d5bf4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:36:21Z,use_quota=True,user_id='4ceb8ccadf5841b685db644f1253c5a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:36:21 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [req-069cf8d1-24ad-4ce8-b173-949a255d1efc req-89084515-95cc-49e7-9629-3ce390599ce6 tempest-VolumesGetTestJSON-747977406 None] Creating volume 82be5160-abcb-4fa8-aca1-feb76b83fd82 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:36:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-069cf8d1-24ad-4ce8-b173-949a255d1efc req-89084515-95cc-49e7-9629-3ce390599ce6 tempest-VolumesGetTestJSON-747977406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:36:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-069cf8d1-24ad-4ce8-b173-949a255d1efc req-89084515-95cc-49e7-9629-3ce390599ce6 tempest-VolumesGetTestJSON-747977406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:36:21 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [req-069cf8d1-24ad-4ce8-b173-949a255d1efc req-89084515-95cc-49e7-9629-3ce390599ce6 tempest-VolumesGetTestJSON-747977406 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:36:21 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [req-069cf8d1-24ad-4ce8-b173-949a255d1efc req-89084515-95cc-49e7-9629-3ce390599ce6 tempest-VolumesGetTestJSON-747977406 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:36:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-069cf8d1-24ad-4ce8-b173-949a255d1efc req-89084515-95cc-49e7-9629-3ce390599ce6 tempest-VolumesGetTestJSON-747977406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:36:21 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [req-069cf8d1-24ad-4ce8-b173-949a255d1efc req-89084515-95cc-49e7-9629-3ce390599ce6 tempest-VolumesGetTestJSON-747977406 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:36:21 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [req-069cf8d1-24ad-4ce8-b173-949a255d1efc req-89084515-95cc-49e7-9629-3ce390599ce6 tempest-VolumesGetTestJSON-747977406 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:36:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-069cf8d1-24ad-4ce8-b173-949a255d1efc req-89084515-95cc-49e7-9629-3ce390599ce6 tempest-VolumesGetTestJSON-747977406 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-82be5160-abcb-4fa8-aca1-feb76b83fd82 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:36:21 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=13, name=volume-82be5160-abcb-4fa8-aca1-feb76b83fd82, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:36:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-069cf8d1-24ad-4ce8-b173-949a255d1efc req-89084515-95cc-49e7-9629-3ce390599ce6 tempest-VolumesGetTestJSON-747977406 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-82be5160-abcb-4fa8-aca1-feb76b83fd82 1073741824" returned: 0 in 0.522s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:36:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-069cf8d1-24ad-4ce8-b173-949a255d1efc req-89084515-95cc-49e7-9629-3ce390599ce6 tempest-VolumesGetTestJSON-747977406 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-82be5160-abcb-4fa8-aca1-feb76b83fd82 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:36:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-069cf8d1-24ad-4ce8-b173-949a255d1efc req-89084515-95cc-49e7-9629-3ce390599ce6 tempest-VolumesGetTestJSON-747977406 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-82be5160-abcb-4fa8-aca1-feb76b83fd82" returned: 0 in 0.201s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:36:22 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [req-069cf8d1-24ad-4ce8-b173-949a255d1efc req-89084515-95cc-49e7-9629-3ce390599ce6 tempest-VolumesGetTestJSON-747977406 None] <== create_volume: return (822ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:36:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-069cf8d1-24ad-4ce8-b173-949a255d1efc req-89084515-95cc-49e7-9629-3ce390599ce6 tempest-VolumesGetTestJSON-747977406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:36:22 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-069cf8d1-24ad-4ce8-b173-949a255d1efc req-89084515-95cc-49e7-9629-3ce390599ce6 tempest-VolumesGetTestJSON-747977406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a531da4c-a4fd-4fb2-90a8-d68642fca099) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82be5160-abcb-4fa8-aca1-feb76b83fd82', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:36:22 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-069cf8d1-24ad-4ce8-b173-949a255d1efc req-89084515-95cc-49e7-9629-3ce390599ce6 tempest-VolumesGetTestJSON-747977406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (965421c6-e4b9-4e6e-a641-bb4a8e7bdfa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:36:22 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [req-069cf8d1-24ad-4ce8-b173-949a255d1efc req-89084515-95cc-49e7-9629-3ce390599ce6 tempest-VolumesGetTestJSON-747977406 None] Volume volume-82be5160-abcb-4fa8-aca1-feb76b83fd82 (82be5160-abcb-4fa8-aca1-feb76b83fd82): created successfully
Sep 18 11:36:22 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-069cf8d1-24ad-4ce8-b173-949a255d1efc req-89084515-95cc-49e7-9629-3ce390599ce6 tempest-VolumesGetTestJSON-747977406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (965421c6-e4b9-4e6e-a641-bb4a8e7bdfa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:36:22 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-069cf8d1-24ad-4ce8-b173-949a255d1efc req-89084515-95cc-49e7-9629-3ce390599ce6 tempest-VolumesGetTestJSON-747977406 None] Flow 'volume_create_manager' (85976fb7-48da-46b0-888b-cdd58483a5e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:36:22 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-069cf8d1-24ad-4ce8-b173-949a255d1efc req-89084515-95cc-49e7-9629-3ce390599ce6 tempest-VolumesGetTestJSON-747977406 None] Created volume successfully.
Sep 18 11:36:23 devstack cinder-volume[83176]: DEBUG cinder.coordination [req-a7d11a1e-3f61-40c3-aeaf-032a8ca07c31 req-0ffc987f-1645-4447-afb9-878dc9bf34e6 tempest-VolumesGetTestJSON-747977406 None] Acquiring lock "cinder-82be5160-abcb-4fa8-aca1-feb76b83fd82-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:36:23 devstack cinder-volume[83176]: DEBUG cinder.coordination [req-a7d11a1e-3f61-40c3-aeaf-032a8ca07c31 req-0ffc987f-1645-4447-afb9-878dc9bf34e6 tempest-VolumesGetTestJSON-747977406 None] Lock "cinder-82be5160-abcb-4fa8-aca1-feb76b83fd82-delete_volume" acquired by "delete_volume" :: waited 0.130s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:36:24 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-a7d11a1e-3f61-40c3-aeaf-032a8ca07c31 req-0ffc987f-1645-4447-afb9-878dc9bf34e6 tempest-VolumesGetTestJSON-747977406 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:36:24 devstack cinder-volume[83176]: DEBUG cinder.coordination [req-a7d11a1e-3f61-40c3-aeaf-032a8ca07c31 req-0ffc987f-1645-4447-afb9-878dc9bf34e6 tempest-VolumesGetTestJSON-747977406 None] Acquiring lock "cinder-quobyte-82be5160-abcb-4fa8-aca1-feb76b83fd82" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:36:24 devstack cinder-volume[83176]: DEBUG cinder.coordination [req-a7d11a1e-3f61-40c3-aeaf-032a8ca07c31 req-0ffc987f-1645-4447-afb9-878dc9bf34e6 tempest-VolumesGetTestJSON-747977406 None] Lock "cinder-quobyte-82be5160-abcb-4fa8-aca1-feb76b83fd82" acquired by "delete_volume" :: waited 0.036s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:36:24 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[844b94fb-8173-44e6-83ea-84e3f54d424e]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:36:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-a7d11a1e-3f61-40c3-aeaf-032a8ca07c31 req-0ffc987f-1645-4447-afb9-878dc9bf34e6 tempest-VolumesGetTestJSON-747977406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-82be5160-abcb-4fa8-aca1-feb76b83fd82 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:36:24 devstack quobyte-client[83193]: System call of process 89018 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:36:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-a7d11a1e-3f61-40c3-aeaf-032a8ca07c31 req-0ffc987f-1645-4447-afb9-878dc9bf34e6 tempest-VolumesGetTestJSON-747977406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-82be5160-abcb-4fa8-aca1-feb76b83fd82" returned: 0 in 0.730s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:36:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-a7d11a1e-3f61-40c3-aeaf-032a8ca07c31 req-0ffc987f-1645-4447-afb9-878dc9bf34e6 tempest-VolumesGetTestJSON-747977406 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-82be5160-abcb-4fa8-aca1-feb76b83fd82 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:36:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-a7d11a1e-3f61-40c3-aeaf-032a8ca07c31 req-0ffc987f-1645-4447-afb9-878dc9bf34e6 tempest-VolumesGetTestJSON-747977406 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-82be5160-abcb-4fa8-aca1-feb76b83fd82" returned: 0 in 0.173s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:36:25 devstack cinder-volume[83176]: DEBUG cinder.coordination [req-a7d11a1e-3f61-40c3-aeaf-032a8ca07c31 req-0ffc987f-1645-4447-afb9-878dc9bf34e6 tempest-VolumesGetTestJSON-747977406 None] Lock "cinder-quobyte-82be5160-abcb-4fa8-aca1-feb76b83fd82" released by "delete_volume" :: held 1.246s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:36:25 devstack cinder-volume[83176]: DEBUG cinder.quota [req-a7d11a1e-3f61-40c3-aeaf-032a8ca07c31 req-0ffc987f-1645-4447-afb9-878dc9bf34e6 tempest-VolumesGetTestJSON-747977406 None] Created reservations ['6cbe30e4-e160-47ac-9460-77f93664c46d', 'bcf0fba0-d04f-4510-8edc-0efebc01fdc8', 'b61e0901-6ae8-4d7f-a430-d54ee3110cf2', 'e50aace4-274b-4ee0-a858-d9692172ee90'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:36:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-a7d11a1e-3f61-40c3-aeaf-032a8ca07c31 req-0ffc987f-1645-4447-afb9-878dc9bf34e6 tempest-VolumesGetTestJSON-747977406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:36:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-a7d11a1e-3f61-40c3-aeaf-032a8ca07c31 req-0ffc987f-1645-4447-afb9-878dc9bf34e6 tempest-VolumesGetTestJSON-747977406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:36:26 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [req-a7d11a1e-3f61-40c3-aeaf-032a8ca07c31 req-0ffc987f-1645-4447-afb9-878dc9bf34e6 tempest-VolumesGetTestJSON-747977406 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:36:26 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [req-a7d11a1e-3f61-40c3-aeaf-032a8ca07c31 req-0ffc987f-1645-4447-afb9-878dc9bf34e6 tempest-VolumesGetTestJSON-747977406 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:36:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-a7d11a1e-3f61-40c3-aeaf-032a8ca07c31 req-0ffc987f-1645-4447-afb9-878dc9bf34e6 tempest-VolumesGetTestJSON-747977406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:36:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-a7d11a1e-3f61-40c3-aeaf-032a8ca07c31 req-0ffc987f-1645-4447-afb9-878dc9bf34e6 tempest-VolumesGetTestJSON-747977406 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:36:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-a7d11a1e-3f61-40c3-aeaf-032a8ca07c31 req-0ffc987f-1645-4447-afb9-878dc9bf34e6 tempest-VolumesGetTestJSON-747977406 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.144s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:36:26 devstack cinder-volume[83176]: DEBUG cinder.manager [req-a7d11a1e-3f61-40c3-aeaf-032a8ca07c31 req-0ffc987f-1645-4447-afb9-878dc9bf34e6 tempest-VolumesGetTestJSON-747977406 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:36:26 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-a7d11a1e-3f61-40c3-aeaf-032a8ca07c31 req-0ffc987f-1645-4447-afb9-878dc9bf34e6 tempest-VolumesGetTestJSON-747977406 None] Deleted volume successfully.
Sep 18 11:36:26 devstack cinder-volume[83176]: DEBUG cinder.coordination [req-a7d11a1e-3f61-40c3-aeaf-032a8ca07c31 req-0ffc987f-1645-4447-afb9-878dc9bf34e6 tempest-VolumesGetTestJSON-747977406 None] Lock "cinder-82be5160-abcb-4fa8-aca1-feb76b83fd82-delete_volume" released by "delete_volume" :: held 2.892s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:36:32 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-65bc3cd6-a612-47f2-94a9-fd2df96cbfd9 tempest-VolumesTestJSON-1802531469 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:36:32 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-65bc3cd6-a612-47f2-94a9-fd2df96cbfd9 tempest-VolumesTestJSON-1802531469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:36:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-65bc3cd6-a612-47f2-94a9-fd2df96cbfd9 tempest-VolumesTestJSON-1802531469 None] Flow 'volume_create_manager' (ebe2e2f1-3f34-4ca3-819b-990494fccd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:36:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-65bc3cd6-a612-47f2-94a9-fd2df96cbfd9 tempest-VolumesTestJSON-1802531469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c896c16b-b81e-4486-8add-5532e83f38b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:36:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-65bc3cd6-a612-47f2-94a9-fd2df96cbfd9 tempest-VolumesTestJSON-1802531469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c896c16b-b81e-4486-8add-5532e83f38b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-76189611',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09e44971-0b07-4aaf-a6f1-41e3014a97ae,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='870974d87b964f6ab87d129eabef804c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:36:32Z,use_quota=True,user_id='29c565ce55f24b4bb4f87ba2b0dc4bbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:36:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-65bc3cd6-a612-47f2-94a9-fd2df96cbfd9 tempest-VolumesTestJSON-1802531469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0aafac2-95d3-4d6c-889f-878eb9ab1aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:36:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-65bc3cd6-a612-47f2-94a9-fd2df96cbfd9 tempest-VolumesTestJSON-1802531469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0aafac2-95d3-4d6c-889f-878eb9ab1aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:36:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-65bc3cd6-a612-47f2-94a9-fd2df96cbfd9 tempest-VolumesTestJSON-1802531469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abbe1226-d6a1-4243-a375-5f1d18f24112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:36:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-65bc3cd6-a612-47f2-94a9-fd2df96cbfd9 tempest-VolumesTestJSON-1802531469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abbe1226-d6a1-4243-a375-5f1d18f24112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09e44971-0b07-4aaf-a6f1-41e3014a97ae', 'volume_name': 'volume-09e44971-0b07-4aaf-a6f1-41e3014a97ae', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:36:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-65bc3cd6-a612-47f2-94a9-fd2df96cbfd9 tempest-VolumesTestJSON-1802531469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce7d9b3b-750c-42f5-8be2-9053880a9d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:36:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-65bc3cd6-a612-47f2-94a9-fd2df96cbfd9 tempest-VolumesTestJSON-1802531469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce7d9b3b-750c-42f5-8be2-9053880a9d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:36:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-65bc3cd6-a612-47f2-94a9-fd2df96cbfd9 tempest-VolumesTestJSON-1802531469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (195f85bc-4f69-4e31-ae79-5cd1257acb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:36:32 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-65bc3cd6-a612-47f2-94a9-fd2df96cbfd9 tempest-VolumesTestJSON-1802531469 None] Volume 09e44971-0b07-4aaf-a6f1-41e3014a97ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09e44971-0b07-4aaf-a6f1-41e3014a97ae', 'volume_size': 1}
Sep 18 11:36:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-65bc3cd6-a612-47f2-94a9-fd2df96cbfd9 tempest-VolumesTestJSON-1802531469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:36:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-65bc3cd6-a612-47f2-94a9-fd2df96cbfd9 tempest-VolumesTestJSON-1802531469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:36:32 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-65bc3cd6-a612-47f2-94a9-fd2df96cbfd9 tempest-VolumesTestJSON-1802531469 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-76189611',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09e44971-0b07-4aaf-a6f1-41e3014a97ae,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='870974d87b964f6ab87d129eabef804c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:36:32Z,use_quota=True,user_id='29c565ce55f24b4bb4f87ba2b0dc4bbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:36:32 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-65bc3cd6-a612-47f2-94a9-fd2df96cbfd9 tempest-VolumesTestJSON-1802531469 None] Creating volume 09e44971-0b07-4aaf-a6f1-41e3014a97ae {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:36:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-65bc3cd6-a612-47f2-94a9-fd2df96cbfd9 tempest-VolumesTestJSON-1802531469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:36:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-65bc3cd6-a612-47f2-94a9-fd2df96cbfd9 tempest-VolumesTestJSON-1802531469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:36:32 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-65bc3cd6-a612-47f2-94a9-fd2df96cbfd9 tempest-VolumesTestJSON-1802531469 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:36:32 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-65bc3cd6-a612-47f2-94a9-fd2df96cbfd9 tempest-VolumesTestJSON-1802531469 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:36:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-65bc3cd6-a612-47f2-94a9-fd2df96cbfd9 tempest-VolumesTestJSON-1802531469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:36:32 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-65bc3cd6-a612-47f2-94a9-fd2df96cbfd9 tempest-VolumesTestJSON-1802531469 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:36:32 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-65bc3cd6-a612-47f2-94a9-fd2df96cbfd9 tempest-VolumesTestJSON-1802531469 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:36:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-65bc3cd6-a612-47f2-94a9-fd2df96cbfd9 tempest-VolumesTestJSON-1802531469 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-09e44971-0b07-4aaf-a6f1-41e3014a97ae 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:36:32 devstack quobyte-client[83193]: System call of process 89025 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:36:32 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=14, name=volume-09e44971-0b07-4aaf-a6f1-41e3014a97ae, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:36:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-65bc3cd6-a612-47f2-94a9-fd2df96cbfd9 tempest-VolumesTestJSON-1802531469 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-09e44971-0b07-4aaf-a6f1-41e3014a97ae 1073741824" returned: 0 in 0.546s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:36:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-65bc3cd6-a612-47f2-94a9-fd2df96cbfd9 tempest-VolumesTestJSON-1802531469 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-09e44971-0b07-4aaf-a6f1-41e3014a97ae {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:36:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-65bc3cd6-a612-47f2-94a9-fd2df96cbfd9 tempest-VolumesTestJSON-1802531469 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-09e44971-0b07-4aaf-a6f1-41e3014a97ae" returned: 0 in 0.155s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:36:33 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-65bc3cd6-a612-47f2-94a9-fd2df96cbfd9 tempest-VolumesTestJSON-1802531469 None] <== create_volume: return (795ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:36:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-65bc3cd6-a612-47f2-94a9-fd2df96cbfd9 tempest-VolumesTestJSON-1802531469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:36:33 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-65bc3cd6-a612-47f2-94a9-fd2df96cbfd9 tempest-VolumesTestJSON-1802531469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (195f85bc-4f69-4e31-ae79-5cd1257acb40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09e44971-0b07-4aaf-a6f1-41e3014a97ae', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:36:33 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-65bc3cd6-a612-47f2-94a9-fd2df96cbfd9 tempest-VolumesTestJSON-1802531469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f909bcd3-a999-4da8-ae7f-125308e2365a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:36:33 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-65bc3cd6-a612-47f2-94a9-fd2df96cbfd9 tempest-VolumesTestJSON-1802531469 None] Volume volume-09e44971-0b07-4aaf-a6f1-41e3014a97ae (09e44971-0b07-4aaf-a6f1-41e3014a97ae): created successfully
Sep 18 11:36:33 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-65bc3cd6-a612-47f2-94a9-fd2df96cbfd9 tempest-VolumesTestJSON-1802531469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f909bcd3-a999-4da8-ae7f-125308e2365a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:36:33 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-65bc3cd6-a612-47f2-94a9-fd2df96cbfd9 tempest-VolumesTestJSON-1802531469 None] Flow 'volume_create_manager' (ebe2e2f1-3f34-4ca3-819b-990494fccd4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:36:33 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-65bc3cd6-a612-47f2-94a9-fd2df96cbfd9 tempest-VolumesTestJSON-1802531469 None] Created volume successfully.
Sep 18 11:36:35 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-f08c413c-f078-4279-a606-4786f7db218b tempest-VolumesTestJSON-1802531469 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:36:35 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-f08c413c-f078-4279-a606-4786f7db218b tempest-VolumesTestJSON-1802531469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:36:35 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f08c413c-f078-4279-a606-4786f7db218b tempest-VolumesTestJSON-1802531469 None] Flow 'volume_create_manager' (cb0b288a-ae76-41b9-907e-dd0757ce5925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:36:35 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f08c413c-f078-4279-a606-4786f7db218b tempest-VolumesTestJSON-1802531469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce23e25f-337b-43eb-8f8b-249d960eb9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:36:35 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f08c413c-f078-4279-a606-4786f7db218b tempest-VolumesTestJSON-1802531469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce23e25f-337b-43eb-8f8b-249d960eb9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-426884541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=480fa7b6-6812-4d62-b81d-d2aa17cc8a48,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='870974d87b964f6ab87d129eabef804c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:36:36Z,use_quota=True,user_id='29c565ce55f24b4bb4f87ba2b0dc4bbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:36:35 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f08c413c-f078-4279-a606-4786f7db218b tempest-VolumesTestJSON-1802531469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dbe8c5f-0185-4c14-9151-ec72f60a2c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:36:35 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f08c413c-f078-4279-a606-4786f7db218b tempest-VolumesTestJSON-1802531469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dbe8c5f-0185-4c14-9151-ec72f60a2c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:36:35 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f08c413c-f078-4279-a606-4786f7db218b tempest-VolumesTestJSON-1802531469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adda3260-22b9-483e-a5b4-2674e94d9052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:36:35 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f08c413c-f078-4279-a606-4786f7db218b tempest-VolumesTestJSON-1802531469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adda3260-22b9-483e-a5b4-2674e94d9052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '480fa7b6-6812-4d62-b81d-d2aa17cc8a48', 'volume_name': 'volume-480fa7b6-6812-4d62-b81d-d2aa17cc8a48', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:36:35 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f08c413c-f078-4279-a606-4786f7db218b tempest-VolumesTestJSON-1802531469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1c62e1b-8c8d-46fb-b8e8-3d25576b0e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:36:35 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f08c413c-f078-4279-a606-4786f7db218b tempest-VolumesTestJSON-1802531469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1c62e1b-8c8d-46fb-b8e8-3d25576b0e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:36:35 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f08c413c-f078-4279-a606-4786f7db218b tempest-VolumesTestJSON-1802531469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32a785ac-043c-48b9-b4cc-ad9fd9001350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:36:35 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-f08c413c-f078-4279-a606-4786f7db218b tempest-VolumesTestJSON-1802531469 None] Volume 480fa7b6-6812-4d62-b81d-d2aa17cc8a48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-480fa7b6-6812-4d62-b81d-d2aa17cc8a48', 'volume_size': 1}
Sep 18 11:36:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f08c413c-f078-4279-a606-4786f7db218b tempest-VolumesTestJSON-1802531469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:36:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f08c413c-f078-4279-a606-4786f7db218b tempest-VolumesTestJSON-1802531469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:36:35 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f08c413c-f078-4279-a606-4786f7db218b tempest-VolumesTestJSON-1802531469 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-426884541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=480fa7b6-6812-4d62-b81d-d2aa17cc8a48,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='870974d87b964f6ab87d129eabef804c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:36:36Z,use_quota=True,user_id='29c565ce55f24b4bb4f87ba2b0dc4bbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:36:35 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-f08c413c-f078-4279-a606-4786f7db218b tempest-VolumesTestJSON-1802531469 None] Creating volume 480fa7b6-6812-4d62-b81d-d2aa17cc8a48 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:36:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f08c413c-f078-4279-a606-4786f7db218b tempest-VolumesTestJSON-1802531469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:36:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f08c413c-f078-4279-a606-4786f7db218b tempest-VolumesTestJSON-1802531469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:36:35 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f08c413c-f078-4279-a606-4786f7db218b tempest-VolumesTestJSON-1802531469 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:36:35 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f08c413c-f078-4279-a606-4786f7db218b tempest-VolumesTestJSON-1802531469 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:36:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f08c413c-f078-4279-a606-4786f7db218b tempest-VolumesTestJSON-1802531469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:36:35 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f08c413c-f078-4279-a606-4786f7db218b tempest-VolumesTestJSON-1802531469 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:36:35 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-f08c413c-f078-4279-a606-4786f7db218b tempest-VolumesTestJSON-1802531469 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:36:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f08c413c-f078-4279-a606-4786f7db218b tempest-VolumesTestJSON-1802531469 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-480fa7b6-6812-4d62-b81d-d2aa17cc8a48 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:36:36 devstack quobyte-client[83193]: System call of process 89030 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:36:36 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=15, name=volume-480fa7b6-6812-4d62-b81d-d2aa17cc8a48, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:36:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f08c413c-f078-4279-a606-4786f7db218b tempest-VolumesTestJSON-1802531469 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-480fa7b6-6812-4d62-b81d-d2aa17cc8a48 1073741824" returned: 0 in 0.492s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:36:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f08c413c-f078-4279-a606-4786f7db218b tempest-VolumesTestJSON-1802531469 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-480fa7b6-6812-4d62-b81d-d2aa17cc8a48 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:36:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f08c413c-f078-4279-a606-4786f7db218b tempest-VolumesTestJSON-1802531469 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-480fa7b6-6812-4d62-b81d-d2aa17cc8a48" returned: 0 in 0.172s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:36:36 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f08c413c-f078-4279-a606-4786f7db218b tempest-VolumesTestJSON-1802531469 None] <== create_volume: return (749ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:36:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f08c413c-f078-4279-a606-4786f7db218b tempest-VolumesTestJSON-1802531469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:36:36 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f08c413c-f078-4279-a606-4786f7db218b tempest-VolumesTestJSON-1802531469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32a785ac-043c-48b9-b4cc-ad9fd9001350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-480fa7b6-6812-4d62-b81d-d2aa17cc8a48', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:36:36 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f08c413c-f078-4279-a606-4786f7db218b tempest-VolumesTestJSON-1802531469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22e38612-b96d-441c-9e61-1ab6b17cf71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:36:36 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-f08c413c-f078-4279-a606-4786f7db218b tempest-VolumesTestJSON-1802531469 None] Volume volume-480fa7b6-6812-4d62-b81d-d2aa17cc8a48 (480fa7b6-6812-4d62-b81d-d2aa17cc8a48): created successfully
Sep 18 11:36:36 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f08c413c-f078-4279-a606-4786f7db218b tempest-VolumesTestJSON-1802531469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22e38612-b96d-441c-9e61-1ab6b17cf71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:36:36 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f08c413c-f078-4279-a606-4786f7db218b tempest-VolumesTestJSON-1802531469 None] Flow 'volume_create_manager' (cb0b288a-ae76-41b9-907e-dd0757ce5925) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:36:37 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-f08c413c-f078-4279-a606-4786f7db218b tempest-VolumesTestJSON-1802531469 None] Created volume successfully.
Sep 18 11:36:38 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-44972548-326b-4f3c-a1ff-8c33ebe817f1 tempest-VolumesTestJSON-1802531469 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:36:38 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-44972548-326b-4f3c-a1ff-8c33ebe817f1 tempest-VolumesTestJSON-1802531469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:36:38 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-44972548-326b-4f3c-a1ff-8c33ebe817f1 tempest-VolumesTestJSON-1802531469 None] Flow 'volume_create_manager' (9d53dc5e-2bce-4754-b29c-0c67d9efcbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:36:38 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-44972548-326b-4f3c-a1ff-8c33ebe817f1 tempest-VolumesTestJSON-1802531469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca298616-2207-4aa1-87e8-3af95415919d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:36:38 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-44972548-326b-4f3c-a1ff-8c33ebe817f1 tempest-VolumesTestJSON-1802531469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca298616-2207-4aa1-87e8-3af95415919d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-408354210',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e5b21ed-e47e-4979-92d4-4e31e0dcbf36,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='870974d87b964f6ab87d129eabef804c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:36:38Z,use_quota=True,user_id='29c565ce55f24b4bb4f87ba2b0dc4bbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:36:38 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-44972548-326b-4f3c-a1ff-8c33ebe817f1 tempest-VolumesTestJSON-1802531469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5256c80b-958a-47dc-a403-15956233b090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:36:38 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-44972548-326b-4f3c-a1ff-8c33ebe817f1 tempest-VolumesTestJSON-1802531469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5256c80b-958a-47dc-a403-15956233b090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:36:38 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-44972548-326b-4f3c-a1ff-8c33ebe817f1 tempest-VolumesTestJSON-1802531469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f53b4ac1-9412-4e40-9585-fd58ba9bf989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:36:38 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-44972548-326b-4f3c-a1ff-8c33ebe817f1 tempest-VolumesTestJSON-1802531469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f53b4ac1-9412-4e40-9585-fd58ba9bf989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e5b21ed-e47e-4979-92d4-4e31e0dcbf36', 'volume_name': 'volume-4e5b21ed-e47e-4979-92d4-4e31e0dcbf36', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:36:38 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-44972548-326b-4f3c-a1ff-8c33ebe817f1 tempest-VolumesTestJSON-1802531469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2596f4a1-5686-4032-a143-30f85d62d67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:36:38 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-44972548-326b-4f3c-a1ff-8c33ebe817f1 tempest-VolumesTestJSON-1802531469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2596f4a1-5686-4032-a143-30f85d62d67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:36:38 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-44972548-326b-4f3c-a1ff-8c33ebe817f1 tempest-VolumesTestJSON-1802531469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e63525fa-41ec-4d81-afd6-f6b03610267c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:36:38 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-44972548-326b-4f3c-a1ff-8c33ebe817f1 tempest-VolumesTestJSON-1802531469 None] Volume 4e5b21ed-e47e-4979-92d4-4e31e0dcbf36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e5b21ed-e47e-4979-92d4-4e31e0dcbf36', 'volume_size': 1}
Sep 18 11:36:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-44972548-326b-4f3c-a1ff-8c33ebe817f1 tempest-VolumesTestJSON-1802531469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:36:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-44972548-326b-4f3c-a1ff-8c33ebe817f1 tempest-VolumesTestJSON-1802531469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:36:38 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-44972548-326b-4f3c-a1ff-8c33ebe817f1 tempest-VolumesTestJSON-1802531469 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-408354210',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e5b21ed-e47e-4979-92d4-4e31e0dcbf36,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='870974d87b964f6ab87d129eabef804c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:36:38Z,use_quota=True,user_id='29c565ce55f24b4bb4f87ba2b0dc4bbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:36:38 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-44972548-326b-4f3c-a1ff-8c33ebe817f1 tempest-VolumesTestJSON-1802531469 None] Creating volume 4e5b21ed-e47e-4979-92d4-4e31e0dcbf36 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:36:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-44972548-326b-4f3c-a1ff-8c33ebe817f1 tempest-VolumesTestJSON-1802531469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:36:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-44972548-326b-4f3c-a1ff-8c33ebe817f1 tempest-VolumesTestJSON-1802531469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:36:38 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-44972548-326b-4f3c-a1ff-8c33ebe817f1 tempest-VolumesTestJSON-1802531469 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:36:38 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-44972548-326b-4f3c-a1ff-8c33ebe817f1 tempest-VolumesTestJSON-1802531469 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:36:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-44972548-326b-4f3c-a1ff-8c33ebe817f1 tempest-VolumesTestJSON-1802531469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:36:38 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-44972548-326b-4f3c-a1ff-8c33ebe817f1 tempest-VolumesTestJSON-1802531469 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:36:38 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-44972548-326b-4f3c-a1ff-8c33ebe817f1 tempest-VolumesTestJSON-1802531469 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:36:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-44972548-326b-4f3c-a1ff-8c33ebe817f1 tempest-VolumesTestJSON-1802531469 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4e5b21ed-e47e-4979-92d4-4e31e0dcbf36 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:36:39 devstack quobyte-client[83193]: System call of process 89034 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:36:39 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=16, name=volume-4e5b21ed-e47e-4979-92d4-4e31e0dcbf36, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:36:39 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-44972548-326b-4f3c-a1ff-8c33ebe817f1 tempest-VolumesTestJSON-1802531469 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4e5b21ed-e47e-4979-92d4-4e31e0dcbf36 1073741824" returned: 0 in 0.485s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:36:39 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-44972548-326b-4f3c-a1ff-8c33ebe817f1 tempest-VolumesTestJSON-1802531469 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4e5b21ed-e47e-4979-92d4-4e31e0dcbf36 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:36:39 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-44972548-326b-4f3c-a1ff-8c33ebe817f1 tempest-VolumesTestJSON-1802531469 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4e5b21ed-e47e-4979-92d4-4e31e0dcbf36" returned: 0 in 0.210s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:36:39 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-44972548-326b-4f3c-a1ff-8c33ebe817f1 tempest-VolumesTestJSON-1802531469 None] <== create_volume: return (792ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:36:39 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-44972548-326b-4f3c-a1ff-8c33ebe817f1 tempest-VolumesTestJSON-1802531469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:36:39 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-44972548-326b-4f3c-a1ff-8c33ebe817f1 tempest-VolumesTestJSON-1802531469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e63525fa-41ec-4d81-afd6-f6b03610267c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e5b21ed-e47e-4979-92d4-4e31e0dcbf36', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:36:39 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-44972548-326b-4f3c-a1ff-8c33ebe817f1 tempest-VolumesTestJSON-1802531469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa72342-1f33-496c-ad08-b2d098f9f213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:36:39 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-44972548-326b-4f3c-a1ff-8c33ebe817f1 tempest-VolumesTestJSON-1802531469 None] Volume volume-4e5b21ed-e47e-4979-92d4-4e31e0dcbf36 (4e5b21ed-e47e-4979-92d4-4e31e0dcbf36): created successfully
Sep 18 11:36:39 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-44972548-326b-4f3c-a1ff-8c33ebe817f1 tempest-VolumesTestJSON-1802531469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa72342-1f33-496c-ad08-b2d098f9f213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:36:39 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-44972548-326b-4f3c-a1ff-8c33ebe817f1 tempest-VolumesTestJSON-1802531469 None] Flow 'volume_create_manager' (9d53dc5e-2bce-4754-b29c-0c67d9efcbd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:36:39 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-44972548-326b-4f3c-a1ff-8c33ebe817f1 tempest-VolumesTestJSON-1802531469 None] Created volume successfully.
Sep 18 11:36:42 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-7a5fede7-6df7-4113-a4e3-de760fd35d15 tempest-VolumesTestJSON-1802531469 None] Acquiring lock "cinder-4e5b21ed-e47e-4979-92d4-4e31e0dcbf36-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:36:42 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-7a5fede7-6df7-4113-a4e3-de760fd35d15 tempest-VolumesTestJSON-1802531469 None] Lock "cinder-4e5b21ed-e47e-4979-92d4-4e31e0dcbf36-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:36:42 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-7a5fede7-6df7-4113-a4e3-de760fd35d15 tempest-VolumesTestJSON-1802531469 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:36:42 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-7a5fede7-6df7-4113-a4e3-de760fd35d15 tempest-VolumesTestJSON-1802531469 None] Acquiring lock "cinder-quobyte-4e5b21ed-e47e-4979-92d4-4e31e0dcbf36" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:36:42 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-7a5fede7-6df7-4113-a4e3-de760fd35d15 tempest-VolumesTestJSON-1802531469 None] Lock "cinder-quobyte-4e5b21ed-e47e-4979-92d4-4e31e0dcbf36" acquired by "delete_volume" :: waited 0.020s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:36:42 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a734a4-a234-441d-aa44-174a9c657cf2]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:36:42 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7a5fede7-6df7-4113-a4e3-de760fd35d15 tempest-VolumesTestJSON-1802531469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4e5b21ed-e47e-4979-92d4-4e31e0dcbf36 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:36:43 devstack quobyte-client[83193]: System call of process 89041 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:36:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7a5fede7-6df7-4113-a4e3-de760fd35d15 tempest-VolumesTestJSON-1802531469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4e5b21ed-e47e-4979-92d4-4e31e0dcbf36" returned: 0 in 0.620s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:36:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7a5fede7-6df7-4113-a4e3-de760fd35d15 tempest-VolumesTestJSON-1802531469 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4e5b21ed-e47e-4979-92d4-4e31e0dcbf36 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:36:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7a5fede7-6df7-4113-a4e3-de760fd35d15 tempest-VolumesTestJSON-1802531469 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4e5b21ed-e47e-4979-92d4-4e31e0dcbf36" returned: 0 in 0.146s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:36:43 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-7a5fede7-6df7-4113-a4e3-de760fd35d15 tempest-VolumesTestJSON-1802531469 None] Lock "cinder-quobyte-4e5b21ed-e47e-4979-92d4-4e31e0dcbf36" released by "delete_volume" :: held 1.043s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:36:44 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-7a5fede7-6df7-4113-a4e3-de760fd35d15 tempest-VolumesTestJSON-1802531469 None] Created reservations ['e0badb51-2202-432a-878e-ddd8d60f2204', '1cc5a8b7-95dc-44b1-8460-a703a175f60b', '908b0141-f925-4bc8-951d-c87b9dc78d3b', '74055fbe-e9e9-47a4-8991-e792822512eb'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:36:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-7a5fede7-6df7-4113-a4e3-de760fd35d15 tempest-VolumesTestJSON-1802531469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:36:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-7a5fede7-6df7-4113-a4e3-de760fd35d15 tempest-VolumesTestJSON-1802531469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:36:44 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-7a5fede7-6df7-4113-a4e3-de760fd35d15 tempest-VolumesTestJSON-1802531469 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:36:44 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-7a5fede7-6df7-4113-a4e3-de760fd35d15 tempest-VolumesTestJSON-1802531469 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:36:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-7a5fede7-6df7-4113-a4e3-de760fd35d15 tempest-VolumesTestJSON-1802531469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:36:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7a5fede7-6df7-4113-a4e3-de760fd35d15 tempest-VolumesTestJSON-1802531469 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:36:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7a5fede7-6df7-4113-a4e3-de760fd35d15 tempest-VolumesTestJSON-1802531469 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.105s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:36:44 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-7a5fede7-6df7-4113-a4e3-de760fd35d15 tempest-VolumesTestJSON-1802531469 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:36:44 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-7a5fede7-6df7-4113-a4e3-de760fd35d15 tempest-VolumesTestJSON-1802531469 None] Deleted volume successfully.
Sep 18 11:36:44 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-7a5fede7-6df7-4113-a4e3-de760fd35d15 tempest-VolumesTestJSON-1802531469 None] Lock "cinder-4e5b21ed-e47e-4979-92d4-4e31e0dcbf36-delete_volume" released by "delete_volume" :: held 2.056s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:36:44 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-a439811f-c2fe-46c4-878b-5da40e3c7735 tempest-VolumesTestJSON-1802531469 None] Acquiring lock "cinder-480fa7b6-6812-4d62-b81d-d2aa17cc8a48-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:36:45 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-a439811f-c2fe-46c4-878b-5da40e3c7735 tempest-VolumesTestJSON-1802531469 None] Lock "cinder-480fa7b6-6812-4d62-b81d-d2aa17cc8a48-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:36:45 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-a439811f-c2fe-46c4-878b-5da40e3c7735 tempest-VolumesTestJSON-1802531469 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:36:45 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-a439811f-c2fe-46c4-878b-5da40e3c7735 tempest-VolumesTestJSON-1802531469 None] Acquiring lock "cinder-quobyte-480fa7b6-6812-4d62-b81d-d2aa17cc8a48" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:36:45 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-a439811f-c2fe-46c4-878b-5da40e3c7735 tempest-VolumesTestJSON-1802531469 None] Lock "cinder-quobyte-480fa7b6-6812-4d62-b81d-d2aa17cc8a48" acquired by "delete_volume" :: waited 0.024s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:36:45 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3d7426-090b-4f7c-bb9f-9fb492bd8bd9]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:36:45 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a439811f-c2fe-46c4-878b-5da40e3c7735 tempest-VolumesTestJSON-1802531469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-480fa7b6-6812-4d62-b81d-d2aa17cc8a48 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:36:46 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a439811f-c2fe-46c4-878b-5da40e3c7735 tempest-VolumesTestJSON-1802531469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-480fa7b6-6812-4d62-b81d-d2aa17cc8a48" returned: 0 in 0.692s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:36:46 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a439811f-c2fe-46c4-878b-5da40e3c7735 tempest-VolumesTestJSON-1802531469 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-480fa7b6-6812-4d62-b81d-d2aa17cc8a48 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:36:46 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a439811f-c2fe-46c4-878b-5da40e3c7735 tempest-VolumesTestJSON-1802531469 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-480fa7b6-6812-4d62-b81d-d2aa17cc8a48" returned: 0 in 0.116s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:36:46 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-a439811f-c2fe-46c4-878b-5da40e3c7735 tempest-VolumesTestJSON-1802531469 None] Lock "cinder-quobyte-480fa7b6-6812-4d62-b81d-d2aa17cc8a48" released by "delete_volume" :: held 1.019s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:36:46 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-a439811f-c2fe-46c4-878b-5da40e3c7735 tempest-VolumesTestJSON-1802531469 None] Created reservations ['72de5aa2-fe3a-4cc4-893d-d069cecc5306', '5a3f9fa1-ee1b-4a9d-b846-484a37aefe75', '579bb5d2-b3e2-4ea5-ac7d-fb692da1a2f6', 'ecb0bb19-dc6f-4cae-837d-0cc50ad55566'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:36:46 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a439811f-c2fe-46c4-878b-5da40e3c7735 tempest-VolumesTestJSON-1802531469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:36:46 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a439811f-c2fe-46c4-878b-5da40e3c7735 tempest-VolumesTestJSON-1802531469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:36:46 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a439811f-c2fe-46c4-878b-5da40e3c7735 tempest-VolumesTestJSON-1802531469 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:36:46 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a439811f-c2fe-46c4-878b-5da40e3c7735 tempest-VolumesTestJSON-1802531469 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:36:46 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a439811f-c2fe-46c4-878b-5da40e3c7735 tempest-VolumesTestJSON-1802531469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:36:46 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a439811f-c2fe-46c4-878b-5da40e3c7735 tempest-VolumesTestJSON-1802531469 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:36:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a439811f-c2fe-46c4-878b-5da40e3c7735 tempest-VolumesTestJSON-1802531469 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.179s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:36:47 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a439811f-c2fe-46c4-878b-5da40e3c7735 tempest-VolumesTestJSON-1802531469 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:36:47 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-a439811f-c2fe-46c4-878b-5da40e3c7735 tempest-VolumesTestJSON-1802531469 None] Deleted volume successfully.
Sep 18 11:36:47 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-dacacc7b-9f15-4638-a8c6-17ec87ddcb28 tempest-VolumesTestJSON-1802531469 None] Acquiring lock "cinder-09e44971-0b07-4aaf-a6f1-41e3014a97ae-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:36:47 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-a439811f-c2fe-46c4-878b-5da40e3c7735 tempest-VolumesTestJSON-1802531469 None] Lock "cinder-480fa7b6-6812-4d62-b81d-d2aa17cc8a48-delete_volume" released by "delete_volume" :: held 2.757s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:36:47 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-dacacc7b-9f15-4638-a8c6-17ec87ddcb28 tempest-VolumesTestJSON-1802531469 None] Lock "cinder-09e44971-0b07-4aaf-a6f1-41e3014a97ae-delete_volume" acquired by "delete_volume" :: waited 0.115s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:36:48 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-dacacc7b-9f15-4638-a8c6-17ec87ddcb28 tempest-VolumesTestJSON-1802531469 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:36:48 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-dacacc7b-9f15-4638-a8c6-17ec87ddcb28 tempest-VolumesTestJSON-1802531469 None] Acquiring lock "cinder-quobyte-09e44971-0b07-4aaf-a6f1-41e3014a97ae" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:36:48 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-dacacc7b-9f15-4638-a8c6-17ec87ddcb28 tempest-VolumesTestJSON-1802531469 None] Lock "cinder-quobyte-09e44971-0b07-4aaf-a6f1-41e3014a97ae" acquired by "delete_volume" :: waited 0.012s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:36:48 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b325b5-2f0c-49ad-9fac-a33f2778e47f]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:36:48 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-dacacc7b-9f15-4638-a8c6-17ec87ddcb28 tempest-VolumesTestJSON-1802531469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-09e44971-0b07-4aaf-a6f1-41e3014a97ae {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:36:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-dacacc7b-9f15-4638-a8c6-17ec87ddcb28 tempest-VolumesTestJSON-1802531469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-09e44971-0b07-4aaf-a6f1-41e3014a97ae" returned: 0 in 1.321s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:36:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-dacacc7b-9f15-4638-a8c6-17ec87ddcb28 tempest-VolumesTestJSON-1802531469 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-09e44971-0b07-4aaf-a6f1-41e3014a97ae {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:36:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-dacacc7b-9f15-4638-a8c6-17ec87ddcb28 tempest-VolumesTestJSON-1802531469 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-09e44971-0b07-4aaf-a6f1-41e3014a97ae" returned: 0 in 0.190s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:36:50 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-dacacc7b-9f15-4638-a8c6-17ec87ddcb28 tempest-VolumesTestJSON-1802531469 None] Lock "cinder-quobyte-09e44971-0b07-4aaf-a6f1-41e3014a97ae" released by "delete_volume" :: held 1.947s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:36:51 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-dacacc7b-9f15-4638-a8c6-17ec87ddcb28 tempest-VolumesTestJSON-1802531469 None] Created reservations ['afd2b98a-1edd-4b9a-a680-37bea1c4fb2b', '45d20a0a-6440-4be1-a78f-163b34a21204', '3d13ea42-e7f9-4d9d-9624-9976121d3b0f', '0825141e-bb93-4b0b-b7a0-950c5792eb2f'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:36:51 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-dacacc7b-9f15-4638-a8c6-17ec87ddcb28 tempest-VolumesTestJSON-1802531469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:36:51 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-dacacc7b-9f15-4638-a8c6-17ec87ddcb28 tempest-VolumesTestJSON-1802531469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:36:51 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-dacacc7b-9f15-4638-a8c6-17ec87ddcb28 tempest-VolumesTestJSON-1802531469 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:36:51 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-dacacc7b-9f15-4638-a8c6-17ec87ddcb28 tempest-VolumesTestJSON-1802531469 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:36:51 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-dacacc7b-9f15-4638-a8c6-17ec87ddcb28 tempest-VolumesTestJSON-1802531469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:36:51 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-dacacc7b-9f15-4638-a8c6-17ec87ddcb28 tempest-VolumesTestJSON-1802531469 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:36:51 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-dacacc7b-9f15-4638-a8c6-17ec87ddcb28 tempest-VolumesTestJSON-1802531469 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.191s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:36:51 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-dacacc7b-9f15-4638-a8c6-17ec87ddcb28 tempest-VolumesTestJSON-1802531469 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:36:51 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-dacacc7b-9f15-4638-a8c6-17ec87ddcb28 tempest-VolumesTestJSON-1802531469 None] Deleted volume successfully.
Sep 18 11:36:52 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-dacacc7b-9f15-4638-a8c6-17ec87ddcb28 tempest-VolumesTestJSON-1802531469 None] Lock "cinder-09e44971-0b07-4aaf-a6f1-41e3014a97ae-delete_volume" released by "delete_volume" :: held 4.707s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:37:01 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=24,cinder:UPDATE=34,cinder:INSERT=9,cinder:DELETE=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:37:02 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:UPDATE=47,cinder:DELETE=7,cinder:SELECT=25,cinder:INSERT=7 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:37:04 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b413c6b7-bbbd-4567-a970-28a7528534ad tempest-BackendsCapabilitiesAdminTestsJSON-445516552 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9154739379883, 'free_capacity_gb': 924.9154739379883, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83176) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Sep 18 11:37:05 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-5c141a69-7321-4fe0-86bd-5e9eec318998 tempest-BackendsCapabilitiesAdminTestsJSON-445516552 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9154739379883, 'free_capacity_gb': 924.9154739379883, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83176) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Sep 18 11:37:13 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 11:37:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:37:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:37:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:37:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:37:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.150s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:37:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:37:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.596s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:37:14 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:37:26 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-0be2e563-9c6f-4279-b1be-bae01b3be6ce req-b534a034-214f-4ebd-a3eb-feb87ecbbdbf tempest-TaggedBootDevicesTest-1687567533 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:37:26 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-0be2e563-9c6f-4279-b1be-bae01b3be6ce req-b534a034-214f-4ebd-a3eb-feb87ecbbdbf tempest-TaggedBootDevicesTest-1687567533 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:37:26 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-0be2e563-9c6f-4279-b1be-bae01b3be6ce req-b534a034-214f-4ebd-a3eb-feb87ecbbdbf tempest-TaggedBootDevicesTest-1687567533 None] Terminate volume connection completed successfully.
Sep 18 11:37:26 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-0be2e563-9c6f-4279-b1be-bae01b3be6ce req-b534a034-214f-4ebd-a3eb-feb87ecbbdbf tempest-TaggedBootDevicesTest-1687567533 None] Deleting attachment ef838af5-fff5-440a-9676-1ab1c9eedc12. {{(pid=83176) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 11:37:27 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-0be2e563-9c6f-4279-b1be-bae01b3be6ce req-15f02355-1d84-497e-a660-84bc338a783a tempest-TaggedBootDevicesTest-1687567533 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:37:27 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-0be2e563-9c6f-4279-b1be-bae01b3be6ce req-15f02355-1d84-497e-a660-84bc338a783a tempest-TaggedBootDevicesTest-1687567533 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:37:27 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-0be2e563-9c6f-4279-b1be-bae01b3be6ce req-15f02355-1d84-497e-a660-84bc338a783a tempest-TaggedBootDevicesTest-1687567533 None] Terminate volume connection completed successfully.
Sep 18 11:37:27 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-0be2e563-9c6f-4279-b1be-bae01b3be6ce req-15f02355-1d84-497e-a660-84bc338a783a tempest-TaggedBootDevicesTest-1687567533 None] Deleting attachment c91c3e5a-0b76-4390-8188-4fd51a53c666. {{(pid=83176) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 11:37:27 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-0be2e563-9c6f-4279-b1be-bae01b3be6ce req-8fe7f580-d57e-4659-b0c2-b510586135ef tempest-TaggedBootDevicesTest-1687567533 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:37:27 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-0be2e563-9c6f-4279-b1be-bae01b3be6ce req-8fe7f580-d57e-4659-b0c2-b510586135ef tempest-TaggedBootDevicesTest-1687567533 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:37:27 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-0be2e563-9c6f-4279-b1be-bae01b3be6ce req-8fe7f580-d57e-4659-b0c2-b510586135ef tempest-TaggedBootDevicesTest-1687567533 None] Terminate volume connection completed successfully.
Sep 18 11:37:27 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-0be2e563-9c6f-4279-b1be-bae01b3be6ce req-8fe7f580-d57e-4659-b0c2-b510586135ef tempest-TaggedBootDevicesTest-1687567533 None] Deleting attachment 1091ab78-53cb-482a-987a-1474f90ad25d. {{(pid=83176) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 11:37:37 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=3 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:37:37 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=3 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:37:40 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4ed56343-48b7-4797-92fc-956d7103f2f5 tempest-TaggedBootDevicesTest-1687567533 None] Acquiring lock "cinder-f9c8f419-a659-40bc-ae4f-c6c2caf8abf9-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:37:40 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4ed56343-48b7-4797-92fc-956d7103f2f5 tempest-TaggedBootDevicesTest-1687567533 None] Lock "cinder-f9c8f419-a659-40bc-ae4f-c6c2caf8abf9-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:37:40 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-4ed56343-48b7-4797-92fc-956d7103f2f5 tempest-TaggedBootDevicesTest-1687567533 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:37:40 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4ed56343-48b7-4797-92fc-956d7103f2f5 tempest-TaggedBootDevicesTest-1687567533 None] Acquiring lock "cinder-quobyte-f9c8f419-a659-40bc-ae4f-c6c2caf8abf9" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:37:40 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4ed56343-48b7-4797-92fc-956d7103f2f5 tempest-TaggedBootDevicesTest-1687567533 None] Lock "cinder-quobyte-f9c8f419-a659-40bc-ae4f-c6c2caf8abf9" acquired by "delete_volume" :: waited 0.033s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:37:41 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f952797-66fe-434d-bb7c-7645961135bb]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:37:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4ed56343-48b7-4797-92fc-956d7103f2f5 tempest-TaggedBootDevicesTest-1687567533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f9c8f419-a659-40bc-ae4f-c6c2caf8abf9 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:37:41 devstack quobyte-client[83193]: System call of process 89548 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:37:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4ed56343-48b7-4797-92fc-956d7103f2f5 tempest-TaggedBootDevicesTest-1687567533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f9c8f419-a659-40bc-ae4f-c6c2caf8abf9" returned: 0 in 0.632s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:37:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4ed56343-48b7-4797-92fc-956d7103f2f5 tempest-TaggedBootDevicesTest-1687567533 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f9c8f419-a659-40bc-ae4f-c6c2caf8abf9 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:37:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4ed56343-48b7-4797-92fc-956d7103f2f5 tempest-TaggedBootDevicesTest-1687567533 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f9c8f419-a659-40bc-ae4f-c6c2caf8abf9" returned: 0 in 0.119s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:37:41 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4ed56343-48b7-4797-92fc-956d7103f2f5 tempest-TaggedBootDevicesTest-1687567533 None] Lock "cinder-quobyte-f9c8f419-a659-40bc-ae4f-c6c2caf8abf9" released by "delete_volume" :: held 0.978s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:37:42 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-4ed56343-48b7-4797-92fc-956d7103f2f5 tempest-TaggedBootDevicesTest-1687567533 None] Created reservations ['287380ae-4ce8-4e5b-9510-b10abda6e4c5', '1644d8c1-0b3c-4f6b-a9df-decc2ae93658', 'b3737737-e779-4fd1-ab22-ab472a08415d', 'e37b482c-9463-4937-9f7f-df979a515faa'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:37:42 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4ed56343-48b7-4797-92fc-956d7103f2f5 tempest-TaggedBootDevicesTest-1687567533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:37:42 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4ed56343-48b7-4797-92fc-956d7103f2f5 tempest-TaggedBootDevicesTest-1687567533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:37:42 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-4ed56343-48b7-4797-92fc-956d7103f2f5 tempest-TaggedBootDevicesTest-1687567533 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:37:42 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-4ed56343-48b7-4797-92fc-956d7103f2f5 tempest-TaggedBootDevicesTest-1687567533 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:37:42 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4ed56343-48b7-4797-92fc-956d7103f2f5 tempest-TaggedBootDevicesTest-1687567533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:37:42 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4ed56343-48b7-4797-92fc-956d7103f2f5 tempest-TaggedBootDevicesTest-1687567533 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:37:42 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4ed56343-48b7-4797-92fc-956d7103f2f5 tempest-TaggedBootDevicesTest-1687567533 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.131s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:37:42 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-4ed56343-48b7-4797-92fc-956d7103f2f5 tempest-TaggedBootDevicesTest-1687567533 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:37:42 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-4ed56343-48b7-4797-92fc-956d7103f2f5 tempest-TaggedBootDevicesTest-1687567533 None] Deleted volume successfully.
Sep 18 11:37:43 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4ed56343-48b7-4797-92fc-956d7103f2f5 tempest-TaggedBootDevicesTest-1687567533 None] Lock "cinder-f9c8f419-a659-40bc-ae4f-c6c2caf8abf9-delete_volume" released by "delete_volume" :: held 2.319s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:37:43 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-bec22470-6a94-4d0a-9324-76c9ba172794 tempest-TaggedBootDevicesTest-1687567533 None] Acquiring lock "cinder-f79f2e6b-9bc6-431a-a74c-9c406afa1f8c-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:37:43 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-bec22470-6a94-4d0a-9324-76c9ba172794 tempest-TaggedBootDevicesTest-1687567533 None] Lock "cinder-f79f2e6b-9bc6-431a-a74c-9c406afa1f8c-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:37:43 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-bec22470-6a94-4d0a-9324-76c9ba172794 tempest-TaggedBootDevicesTest-1687567533 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:37:43 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-bec22470-6a94-4d0a-9324-76c9ba172794 tempest-TaggedBootDevicesTest-1687567533 None] Acquiring lock "cinder-quobyte-f79f2e6b-9bc6-431a-a74c-9c406afa1f8c" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:37:43 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-bec22470-6a94-4d0a-9324-76c9ba172794 tempest-TaggedBootDevicesTest-1687567533 None] Lock "cinder-quobyte-f79f2e6b-9bc6-431a-a74c-9c406afa1f8c" acquired by "delete_volume" :: waited 0.031s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:37:43 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e2c6e0-e38d-4e5e-a590-275dea698cb5]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:37:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-bec22470-6a94-4d0a-9324-76c9ba172794 tempest-TaggedBootDevicesTest-1687567533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f79f2e6b-9bc6-431a-a74c-9c406afa1f8c {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:37:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-bec22470-6a94-4d0a-9324-76c9ba172794 tempest-TaggedBootDevicesTest-1687567533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f79f2e6b-9bc6-431a-a74c-9c406afa1f8c" returned: 0 in 0.563s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:37:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-bec22470-6a94-4d0a-9324-76c9ba172794 tempest-TaggedBootDevicesTest-1687567533 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f79f2e6b-9bc6-431a-a74c-9c406afa1f8c {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:37:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-bec22470-6a94-4d0a-9324-76c9ba172794 tempest-TaggedBootDevicesTest-1687567533 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f79f2e6b-9bc6-431a-a74c-9c406afa1f8c" returned: 0 in 0.127s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:37:44 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-bec22470-6a94-4d0a-9324-76c9ba172794 tempest-TaggedBootDevicesTest-1687567533 None] Lock "cinder-quobyte-f79f2e6b-9bc6-431a-a74c-9c406afa1f8c" released by "delete_volume" :: held 0.910s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:37:44 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-bec22470-6a94-4d0a-9324-76c9ba172794 tempest-TaggedBootDevicesTest-1687567533 None] Created reservations ['cff5c231-5b0c-4f21-a047-f4d68ef6b270', '7e4d85e2-56a1-4036-a8e5-7f29e9e13f71', 'cb6dd3ec-8951-47c0-8844-d6ed742ee06d', '47b3c8d4-6553-4c03-b41f-08a945e61091'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:37:45 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-bec22470-6a94-4d0a-9324-76c9ba172794 tempest-TaggedBootDevicesTest-1687567533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:37:45 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-bec22470-6a94-4d0a-9324-76c9ba172794 tempest-TaggedBootDevicesTest-1687567533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:37:45 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-bec22470-6a94-4d0a-9324-76c9ba172794 tempest-TaggedBootDevicesTest-1687567533 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:37:45 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-bec22470-6a94-4d0a-9324-76c9ba172794 tempest-TaggedBootDevicesTest-1687567533 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:37:45 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-bec22470-6a94-4d0a-9324-76c9ba172794 tempest-TaggedBootDevicesTest-1687567533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:37:45 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-bec22470-6a94-4d0a-9324-76c9ba172794 tempest-TaggedBootDevicesTest-1687567533 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:37:45 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-bec22470-6a94-4d0a-9324-76c9ba172794 tempest-TaggedBootDevicesTest-1687567533 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.147s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:37:45 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-bec22470-6a94-4d0a-9324-76c9ba172794 tempest-TaggedBootDevicesTest-1687567533 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:37:45 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-bec22470-6a94-4d0a-9324-76c9ba172794 tempest-TaggedBootDevicesTest-1687567533 None] Deleted volume successfully.
Sep 18 11:37:45 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-bec22470-6a94-4d0a-9324-76c9ba172794 tempest-TaggedBootDevicesTest-1687567533 None] Lock "cinder-f79f2e6b-9bc6-431a-a74c-9c406afa1f8c-delete_volume" released by "delete_volume" :: held 2.100s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:37:45 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-49775285-f04d-4883-8f55-5ede1fa10086 tempest-TaggedBootDevicesTest-1687567533 None] Acquiring lock "cinder-aa0f4605-3d3e-4092-8d32-f88d3a202cc5-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:37:45 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-49775285-f04d-4883-8f55-5ede1fa10086 tempest-TaggedBootDevicesTest-1687567533 None] Lock "cinder-aa0f4605-3d3e-4092-8d32-f88d3a202cc5-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:37:46 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-49775285-f04d-4883-8f55-5ede1fa10086 tempest-TaggedBootDevicesTest-1687567533 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:37:46 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-49775285-f04d-4883-8f55-5ede1fa10086 tempest-TaggedBootDevicesTest-1687567533 None] Acquiring lock "cinder-quobyte-aa0f4605-3d3e-4092-8d32-f88d3a202cc5" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:37:46 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-49775285-f04d-4883-8f55-5ede1fa10086 tempest-TaggedBootDevicesTest-1687567533 None] Lock "cinder-quobyte-aa0f4605-3d3e-4092-8d32-f88d3a202cc5" acquired by "delete_volume" :: waited 0.021s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:37:46 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f3d023-fc94-4a19-9313-ea447de89046]: (4, 'raw') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:37:46 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-49775285-f04d-4883-8f55-5ede1fa10086 tempest-TaggedBootDevicesTest-1687567533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-aa0f4605-3d3e-4092-8d32-f88d3a202cc5 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:37:46 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-49775285-f04d-4883-8f55-5ede1fa10086 tempest-TaggedBootDevicesTest-1687567533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-aa0f4605-3d3e-4092-8d32-f88d3a202cc5" returned: 0 in 0.631s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:37:46 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-49775285-f04d-4883-8f55-5ede1fa10086 tempest-TaggedBootDevicesTest-1687567533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-aa0f4605-3d3e-4092-8d32-f88d3a202cc5 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:37:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-49775285-f04d-4883-8f55-5ede1fa10086 tempest-TaggedBootDevicesTest-1687567533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-aa0f4605-3d3e-4092-8d32-f88d3a202cc5" returned: 1 in 0.915s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:37:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-49775285-f04d-4883-8f55-5ede1fa10086 tempest-TaggedBootDevicesTest-1687567533 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-aa0f4605-3d3e-4092-8d32-f88d3a202cc5' failed. Not Retrying. {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 11:37:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-49775285-f04d-4883-8f55-5ede1fa10086 tempest-TaggedBootDevicesTest-1687567533 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-aa0f4605-3d3e-4092-8d32-f88d3a202cc5 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:37:47 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-de5a4c79-5ce8-4465-83f6-f0561d248598 tempest-VolumeQuotasAdminTestJSON-454082416 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:37:47 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-de5a4c79-5ce8-4465-83f6-f0561d248598 tempest-VolumeQuotasAdminTestJSON-454082416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:37:48 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-de5a4c79-5ce8-4465-83f6-f0561d248598 tempest-VolumeQuotasAdminTestJSON-454082416 None] Flow 'volume_create_manager' (7c29d702-ad36-433b-b79f-9d7b1d933d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:37:48 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-de5a4c79-5ce8-4465-83f6-f0561d248598 tempest-VolumeQuotasAdminTestJSON-454082416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c8b3b13-447a-4ee9-8022-ff048d80782e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:37:48 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-49775285-f04d-4883-8f55-5ede1fa10086 tempest-TaggedBootDevicesTest-1687567533 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-aa0f4605-3d3e-4092-8d32-f88d3a202cc5" returned: 0 in 0.459s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:37:48 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-de5a4c79-5ce8-4465-83f6-f0561d248598 tempest-VolumeQuotasAdminTestJSON-454082416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c8b3b13-447a-4ee9-8022-ff048d80782e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1980871080',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66395d21-8c67-4ee5-9cbf-f42b2d37c6d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0916b148849e43f39e93383e26a95aab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:37:47Z,use_quota=True,user_id='e871da9e6c694301a7e2c8b8f8d3f5dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:37:48 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-de5a4c79-5ce8-4465-83f6-f0561d248598 tempest-VolumeQuotasAdminTestJSON-454082416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (962ece24-5c65-4768-9cd3-330914b1b7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:37:48 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-de5a4c79-5ce8-4465-83f6-f0561d248598 tempest-VolumeQuotasAdminTestJSON-454082416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (962ece24-5c65-4768-9cd3-330914b1b7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:37:48 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-de5a4c79-5ce8-4465-83f6-f0561d248598 tempest-VolumeQuotasAdminTestJSON-454082416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b17a4937-984d-4067-a70e-d0848c6cf0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:37:48 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-de5a4c79-5ce8-4465-83f6-f0561d248598 tempest-VolumeQuotasAdminTestJSON-454082416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b17a4937-984d-4067-a70e-d0848c6cf0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66395d21-8c67-4ee5-9cbf-f42b2d37c6d9', 'volume_name': 'volume-66395d21-8c67-4ee5-9cbf-f42b2d37c6d9', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:37:48 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-de5a4c79-5ce8-4465-83f6-f0561d248598 tempest-VolumeQuotasAdminTestJSON-454082416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aff6d7a-d147-4b2a-aa7c-ad68acf4874f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:37:48 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-de5a4c79-5ce8-4465-83f6-f0561d248598 tempest-VolumeQuotasAdminTestJSON-454082416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aff6d7a-d147-4b2a-aa7c-ad68acf4874f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:37:48 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-de5a4c79-5ce8-4465-83f6-f0561d248598 tempest-VolumeQuotasAdminTestJSON-454082416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4680c7d-52db-46e8-b4b1-deb1287e50d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:37:48 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-de5a4c79-5ce8-4465-83f6-f0561d248598 tempest-VolumeQuotasAdminTestJSON-454082416 None] Volume 66395d21-8c67-4ee5-9cbf-f42b2d37c6d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66395d21-8c67-4ee5-9cbf-f42b2d37c6d9', 'volume_size': 1}
Sep 18 11:37:48 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-de5a4c79-5ce8-4465-83f6-f0561d248598 tempest-VolumeQuotasAdminTestJSON-454082416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:37:48 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-de5a4c79-5ce8-4465-83f6-f0561d248598 tempest-VolumeQuotasAdminTestJSON-454082416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:37:48 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-de5a4c79-5ce8-4465-83f6-f0561d248598 tempest-VolumeQuotasAdminTestJSON-454082416 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1980871080',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66395d21-8c67-4ee5-9cbf-f42b2d37c6d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0916b148849e43f39e93383e26a95aab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:37:47Z,use_quota=True,user_id='e871da9e6c694301a7e2c8b8f8d3f5dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:37:48 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-de5a4c79-5ce8-4465-83f6-f0561d248598 tempest-VolumeQuotasAdminTestJSON-454082416 None] Creating volume 66395d21-8c67-4ee5-9cbf-f42b2d37c6d9 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:37:48 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-de5a4c79-5ce8-4465-83f6-f0561d248598 tempest-VolumeQuotasAdminTestJSON-454082416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:37:48 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-de5a4c79-5ce8-4465-83f6-f0561d248598 tempest-VolumeQuotasAdminTestJSON-454082416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:37:48 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-de5a4c79-5ce8-4465-83f6-f0561d248598 tempest-VolumeQuotasAdminTestJSON-454082416 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:37:48 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-de5a4c79-5ce8-4465-83f6-f0561d248598 tempest-VolumeQuotasAdminTestJSON-454082416 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:37:48 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-de5a4c79-5ce8-4465-83f6-f0561d248598 tempest-VolumeQuotasAdminTestJSON-454082416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:37:48 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-de5a4c79-5ce8-4465-83f6-f0561d248598 tempest-VolumeQuotasAdminTestJSON-454082416 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:37:48 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-de5a4c79-5ce8-4465-83f6-f0561d248598 tempest-VolumeQuotasAdminTestJSON-454082416 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:37:48 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-de5a4c79-5ce8-4465-83f6-f0561d248598 tempest-VolumeQuotasAdminTestJSON-454082416 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-66395d21-8c67-4ee5-9cbf-f42b2d37c6d9 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:37:48 devstack quobyte-client[83193]: System call of process 89579 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:37:48 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=17, name=volume-66395d21-8c67-4ee5-9cbf-f42b2d37c6d9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:37:48 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-49775285-f04d-4883-8f55-5ede1fa10086 tempest-TaggedBootDevicesTest-1687567533 None] Lock "cinder-quobyte-aa0f4605-3d3e-4092-8d32-f88d3a202cc5" released by "delete_volume" :: held 2.586s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:37:48 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-de5a4c79-5ce8-4465-83f6-f0561d248598 tempest-VolumeQuotasAdminTestJSON-454082416 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-66395d21-8c67-4ee5-9cbf-f42b2d37c6d9 1073741824" returned: 0 in 0.556s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:37:48 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-de5a4c79-5ce8-4465-83f6-f0561d248598 tempest-VolumeQuotasAdminTestJSON-454082416 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-66395d21-8c67-4ee5-9cbf-f42b2d37c6d9 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:37:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-de5a4c79-5ce8-4465-83f6-f0561d248598 tempest-VolumeQuotasAdminTestJSON-454082416 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-66395d21-8c67-4ee5-9cbf-f42b2d37c6d9" returned: 0 in 0.341s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:37:49 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-de5a4c79-5ce8-4465-83f6-f0561d248598 tempest-VolumeQuotasAdminTestJSON-454082416 None] <== create_volume: return (934ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:37:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-de5a4c79-5ce8-4465-83f6-f0561d248598 tempest-VolumeQuotasAdminTestJSON-454082416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:37:49 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-de5a4c79-5ce8-4465-83f6-f0561d248598 tempest-VolumeQuotasAdminTestJSON-454082416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4680c7d-52db-46e8-b4b1-deb1287e50d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66395d21-8c67-4ee5-9cbf-f42b2d37c6d9', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:37:49 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-de5a4c79-5ce8-4465-83f6-f0561d248598 tempest-VolumeQuotasAdminTestJSON-454082416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76f6bd38-43bf-4e0b-8367-5eed7b3acb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:37:49 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-49775285-f04d-4883-8f55-5ede1fa10086 tempest-TaggedBootDevicesTest-1687567533 None] Created reservations ['93b5e24d-1e09-4b10-b6f6-ee074c3d8374', 'ba3979a7-a201-4c97-993d-1efee2d223fb', '41499c53-7dae-4e94-b17d-d6099c1573b6', '4bd2bbdd-97ee-43c3-aa3f-48b2bb982c5c'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:37:49 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-de5a4c79-5ce8-4465-83f6-f0561d248598 tempest-VolumeQuotasAdminTestJSON-454082416 None] Volume volume-66395d21-8c67-4ee5-9cbf-f42b2d37c6d9 (66395d21-8c67-4ee5-9cbf-f42b2d37c6d9): created successfully
Sep 18 11:37:49 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-de5a4c79-5ce8-4465-83f6-f0561d248598 tempest-VolumeQuotasAdminTestJSON-454082416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76f6bd38-43bf-4e0b-8367-5eed7b3acb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:37:49 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-de5a4c79-5ce8-4465-83f6-f0561d248598 tempest-VolumeQuotasAdminTestJSON-454082416 None] Flow 'volume_create_manager' (7c29d702-ad36-433b-b79f-9d7b1d933d70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:37:49 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-de5a4c79-5ce8-4465-83f6-f0561d248598 tempest-VolumeQuotasAdminTestJSON-454082416 None] Created volume successfully.
Sep 18 11:37:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-49775285-f04d-4883-8f55-5ede1fa10086 tempest-TaggedBootDevicesTest-1687567533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:37:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-49775285-f04d-4883-8f55-5ede1fa10086 tempest-TaggedBootDevicesTest-1687567533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:37:49 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-49775285-f04d-4883-8f55-5ede1fa10086 tempest-TaggedBootDevicesTest-1687567533 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:37:49 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-49775285-f04d-4883-8f55-5ede1fa10086 tempest-TaggedBootDevicesTest-1687567533 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:37:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-49775285-f04d-4883-8f55-5ede1fa10086 tempest-TaggedBootDevicesTest-1687567533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:37:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-49775285-f04d-4883-8f55-5ede1fa10086 tempest-TaggedBootDevicesTest-1687567533 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:37:49 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-50234720-65e5-4f21-b8e2-bd599c6ae82e tempest-VolumeQuotasAdminTestJSON-454082416 None] Acquiring lock "cinder-66395d21-8c67-4ee5-9cbf-f42b2d37c6d9-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:37:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-49775285-f04d-4883-8f55-5ede1fa10086 tempest-TaggedBootDevicesTest-1687567533 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.317s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:37:50 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-49775285-f04d-4883-8f55-5ede1fa10086 tempest-TaggedBootDevicesTest-1687567533 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:37:50 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-49775285-f04d-4883-8f55-5ede1fa10086 tempest-TaggedBootDevicesTest-1687567533 None] Deleted volume successfully.
Sep 18 11:37:50 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-50234720-65e5-4f21-b8e2-bd599c6ae82e tempest-VolumeQuotasAdminTestJSON-454082416 None] Lock "cinder-66395d21-8c67-4ee5-9cbf-f42b2d37c6d9-delete_volume" acquired by "delete_volume" :: waited 0.280s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:37:50 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-49775285-f04d-4883-8f55-5ede1fa10086 tempest-TaggedBootDevicesTest-1687567533 None] Lock "cinder-aa0f4605-3d3e-4092-8d32-f88d3a202cc5-delete_volume" released by "delete_volume" :: held 4.371s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:37:50 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-50234720-65e5-4f21-b8e2-bd599c6ae82e tempest-VolumeQuotasAdminTestJSON-454082416 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:37:50 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-50234720-65e5-4f21-b8e2-bd599c6ae82e tempest-VolumeQuotasAdminTestJSON-454082416 None] Acquiring lock "cinder-quobyte-66395d21-8c67-4ee5-9cbf-f42b2d37c6d9" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:37:50 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-50234720-65e5-4f21-b8e2-bd599c6ae82e tempest-VolumeQuotasAdminTestJSON-454082416 None] Lock "cinder-quobyte-66395d21-8c67-4ee5-9cbf-f42b2d37c6d9" acquired by "delete_volume" :: waited 0.016s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:37:50 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6eb629e-bda2-4857-92fe-1c294bde2eb6]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:37:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-50234720-65e5-4f21-b8e2-bd599c6ae82e tempest-VolumeQuotasAdminTestJSON-454082416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-66395d21-8c67-4ee5-9cbf-f42b2d37c6d9 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:37:51 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-50234720-65e5-4f21-b8e2-bd599c6ae82e tempest-VolumeQuotasAdminTestJSON-454082416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-66395d21-8c67-4ee5-9cbf-f42b2d37c6d9" returned: 0 in 0.627s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:37:51 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-50234720-65e5-4f21-b8e2-bd599c6ae82e tempest-VolumeQuotasAdminTestJSON-454082416 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-66395d21-8c67-4ee5-9cbf-f42b2d37c6d9 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:37:51 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-50234720-65e5-4f21-b8e2-bd599c6ae82e tempest-VolumeQuotasAdminTestJSON-454082416 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-66395d21-8c67-4ee5-9cbf-f42b2d37c6d9" returned: 0 in 0.173s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:37:51 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-50234720-65e5-4f21-b8e2-bd599c6ae82e tempest-VolumeQuotasAdminTestJSON-454082416 None] Lock "cinder-quobyte-66395d21-8c67-4ee5-9cbf-f42b2d37c6d9" released by "delete_volume" :: held 1.093s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:37:51 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-50234720-65e5-4f21-b8e2-bd599c6ae82e tempest-VolumeQuotasAdminTestJSON-454082416 None] Created reservations ['0f40bade-05c5-4063-be42-b84f2f7950d9', '6295dc1e-618d-4ca8-8270-0b5ee3bc92dd', '2d32f428-bb1a-48eb-a11f-9c423c29b524', '478c287e-bebc-4c65-883e-aa1b2730c7d7'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:37:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-50234720-65e5-4f21-b8e2-bd599c6ae82e tempest-VolumeQuotasAdminTestJSON-454082416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:37:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-50234720-65e5-4f21-b8e2-bd599c6ae82e tempest-VolumeQuotasAdminTestJSON-454082416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:37:52 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-50234720-65e5-4f21-b8e2-bd599c6ae82e tempest-VolumeQuotasAdminTestJSON-454082416 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:37:52 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-50234720-65e5-4f21-b8e2-bd599c6ae82e tempest-VolumeQuotasAdminTestJSON-454082416 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:37:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-50234720-65e5-4f21-b8e2-bd599c6ae82e tempest-VolumeQuotasAdminTestJSON-454082416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:37:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-50234720-65e5-4f21-b8e2-bd599c6ae82e tempest-VolumeQuotasAdminTestJSON-454082416 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:37:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-50234720-65e5-4f21-b8e2-bd599c6ae82e tempest-VolumeQuotasAdminTestJSON-454082416 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.181s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:37:52 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-50234720-65e5-4f21-b8e2-bd599c6ae82e tempest-VolumeQuotasAdminTestJSON-454082416 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:37:52 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-50234720-65e5-4f21-b8e2-bd599c6ae82e tempest-VolumeQuotasAdminTestJSON-454082416 None] Deleted volume successfully.
Sep 18 11:37:52 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-50234720-65e5-4f21-b8e2-bd599c6ae82e tempest-VolumeQuotasAdminTestJSON-454082416 None] Lock "cinder-66395d21-8c67-4ee5-9cbf-f42b2d37c6d9-delete_volume" released by "delete_volume" :: held 2.600s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:37:53 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-d98fc358-8788-4058-b5a1-a94ed1e1a2ea tempest-VolumeQuotasAdminTestJSON-454082416 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:37:53 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-d98fc358-8788-4058-b5a1-a94ed1e1a2ea tempest-VolumeQuotasAdminTestJSON-454082416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:37:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d98fc358-8788-4058-b5a1-a94ed1e1a2ea tempest-VolumeQuotasAdminTestJSON-454082416 None] Flow 'volume_create_manager' (f271699f-4b06-4071-8249-e3f659523158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:37:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d98fc358-8788-4058-b5a1-a94ed1e1a2ea tempest-VolumeQuotasAdminTestJSON-454082416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c26dbc57-470e-4b1a-9e76-d71d7d5bc945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:37:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d98fc358-8788-4058-b5a1-a94ed1e1a2ea tempest-VolumeQuotasAdminTestJSON-454082416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c26dbc57-470e-4b1a-9e76-d71d7d5bc945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2118595046',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e303f80d-1557-44ee-bbab-26483eaed649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0916b148849e43f39e93383e26a95aab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:37:53Z,use_quota=True,user_id='e871da9e6c694301a7e2c8b8f8d3f5dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:37:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d98fc358-8788-4058-b5a1-a94ed1e1a2ea tempest-VolumeQuotasAdminTestJSON-454082416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20734967-1e1d-42e5-9dcd-814336d1d953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:37:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d98fc358-8788-4058-b5a1-a94ed1e1a2ea tempest-VolumeQuotasAdminTestJSON-454082416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20734967-1e1d-42e5-9dcd-814336d1d953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:37:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d98fc358-8788-4058-b5a1-a94ed1e1a2ea tempest-VolumeQuotasAdminTestJSON-454082416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e692cd76-3d1f-4d04-88d3-593f45e1d4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:37:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d98fc358-8788-4058-b5a1-a94ed1e1a2ea tempest-VolumeQuotasAdminTestJSON-454082416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e692cd76-3d1f-4d04-88d3-593f45e1d4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e303f80d-1557-44ee-bbab-26483eaed649', 'volume_name': 'volume-e303f80d-1557-44ee-bbab-26483eaed649', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:37:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d98fc358-8788-4058-b5a1-a94ed1e1a2ea tempest-VolumeQuotasAdminTestJSON-454082416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (947bf487-006e-4571-b27e-d32031e26e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:37:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d98fc358-8788-4058-b5a1-a94ed1e1a2ea tempest-VolumeQuotasAdminTestJSON-454082416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (947bf487-006e-4571-b27e-d32031e26e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:37:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d98fc358-8788-4058-b5a1-a94ed1e1a2ea tempest-VolumeQuotasAdminTestJSON-454082416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (637c5023-3005-462b-9bab-54aa5b325413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:37:53 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-d98fc358-8788-4058-b5a1-a94ed1e1a2ea tempest-VolumeQuotasAdminTestJSON-454082416 None] Volume e303f80d-1557-44ee-bbab-26483eaed649: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e303f80d-1557-44ee-bbab-26483eaed649', 'volume_size': 1}
Sep 18 11:37:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d98fc358-8788-4058-b5a1-a94ed1e1a2ea tempest-VolumeQuotasAdminTestJSON-454082416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:37:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d98fc358-8788-4058-b5a1-a94ed1e1a2ea tempest-VolumeQuotasAdminTestJSON-454082416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:37:53 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-d98fc358-8788-4058-b5a1-a94ed1e1a2ea tempest-VolumeQuotasAdminTestJSON-454082416 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2118595046',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e303f80d-1557-44ee-bbab-26483eaed649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0916b148849e43f39e93383e26a95aab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:37:53Z,use_quota=True,user_id='e871da9e6c694301a7e2c8b8f8d3f5dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:37:53 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-d98fc358-8788-4058-b5a1-a94ed1e1a2ea tempest-VolumeQuotasAdminTestJSON-454082416 None] Creating volume e303f80d-1557-44ee-bbab-26483eaed649 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:37:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d98fc358-8788-4058-b5a1-a94ed1e1a2ea tempest-VolumeQuotasAdminTestJSON-454082416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:37:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d98fc358-8788-4058-b5a1-a94ed1e1a2ea tempest-VolumeQuotasAdminTestJSON-454082416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:37:53 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-d98fc358-8788-4058-b5a1-a94ed1e1a2ea tempest-VolumeQuotasAdminTestJSON-454082416 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:37:53 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-d98fc358-8788-4058-b5a1-a94ed1e1a2ea tempest-VolumeQuotasAdminTestJSON-454082416 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:37:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d98fc358-8788-4058-b5a1-a94ed1e1a2ea tempest-VolumeQuotasAdminTestJSON-454082416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:37:53 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-d98fc358-8788-4058-b5a1-a94ed1e1a2ea tempest-VolumeQuotasAdminTestJSON-454082416 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:37:53 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-d98fc358-8788-4058-b5a1-a94ed1e1a2ea tempest-VolumeQuotasAdminTestJSON-454082416 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:37:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d98fc358-8788-4058-b5a1-a94ed1e1a2ea tempest-VolumeQuotasAdminTestJSON-454082416 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e303f80d-1557-44ee-bbab-26483eaed649 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:37:54 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=18, name=volume-e303f80d-1557-44ee-bbab-26483eaed649, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:37:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d98fc358-8788-4058-b5a1-a94ed1e1a2ea tempest-VolumeQuotasAdminTestJSON-454082416 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e303f80d-1557-44ee-bbab-26483eaed649 1073741824" returned: 0 in 0.542s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:37:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d98fc358-8788-4058-b5a1-a94ed1e1a2ea tempest-VolumeQuotasAdminTestJSON-454082416 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e303f80d-1557-44ee-bbab-26483eaed649 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:37:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d98fc358-8788-4058-b5a1-a94ed1e1a2ea tempest-VolumeQuotasAdminTestJSON-454082416 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e303f80d-1557-44ee-bbab-26483eaed649" returned: 0 in 0.097s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:37:54 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-d98fc358-8788-4058-b5a1-a94ed1e1a2ea tempest-VolumeQuotasAdminTestJSON-454082416 None] <== create_volume: return (711ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:37:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d98fc358-8788-4058-b5a1-a94ed1e1a2ea tempest-VolumeQuotasAdminTestJSON-454082416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:37:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d98fc358-8788-4058-b5a1-a94ed1e1a2ea tempest-VolumeQuotasAdminTestJSON-454082416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (637c5023-3005-462b-9bab-54aa5b325413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e303f80d-1557-44ee-bbab-26483eaed649', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:37:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d98fc358-8788-4058-b5a1-a94ed1e1a2ea tempest-VolumeQuotasAdminTestJSON-454082416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cda58c9-98f4-4b9a-88e4-9f33bcc6bec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:37:54 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-d98fc358-8788-4058-b5a1-a94ed1e1a2ea tempest-VolumeQuotasAdminTestJSON-454082416 None] Volume volume-e303f80d-1557-44ee-bbab-26483eaed649 (e303f80d-1557-44ee-bbab-26483eaed649): created successfully
Sep 18 11:37:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d98fc358-8788-4058-b5a1-a94ed1e1a2ea tempest-VolumeQuotasAdminTestJSON-454082416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cda58c9-98f4-4b9a-88e4-9f33bcc6bec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:37:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d98fc358-8788-4058-b5a1-a94ed1e1a2ea tempest-VolumeQuotasAdminTestJSON-454082416 None] Flow 'volume_create_manager' (f271699f-4b06-4071-8249-e3f659523158) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:37:54 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-d98fc358-8788-4058-b5a1-a94ed1e1a2ea tempest-VolumeQuotasAdminTestJSON-454082416 None] Created volume successfully.
Sep 18 11:37:56 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-29346f4c-8a4c-4573-b2b7-4fd7a8a3ecd0 tempest-VolumeQuotasAdminTestJSON-130294903 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:37:56 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-29346f4c-8a4c-4573-b2b7-4fd7a8a3ecd0 tempest-VolumeQuotasAdminTestJSON-130294903 None] Transfer volume completed successfully.
Sep 18 11:37:58 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-e63f3aeb-17bf-4f2f-a4a1-48ccd25c8f13 tempest-VolumeQuotasAdminTestJSON-417063872 None] Acquiring lock "cinder-e303f80d-1557-44ee-bbab-26483eaed649-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:37:58 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-e63f3aeb-17bf-4f2f-a4a1-48ccd25c8f13 tempest-VolumeQuotasAdminTestJSON-417063872 None] Lock "cinder-e303f80d-1557-44ee-bbab-26483eaed649-delete_volume" acquired by "delete_volume" :: waited 0.112s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:37:58 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-e63f3aeb-17bf-4f2f-a4a1-48ccd25c8f13 tempest-VolumeQuotasAdminTestJSON-417063872 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:37:58 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-e63f3aeb-17bf-4f2f-a4a1-48ccd25c8f13 tempest-VolumeQuotasAdminTestJSON-417063872 None] Acquiring lock "cinder-quobyte-e303f80d-1557-44ee-bbab-26483eaed649" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:37:58 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-e63f3aeb-17bf-4f2f-a4a1-48ccd25c8f13 tempest-VolumeQuotasAdminTestJSON-417063872 None] Lock "cinder-quobyte-e303f80d-1557-44ee-bbab-26483eaed649" acquired by "delete_volume" :: waited 0.015s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:37:58 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f2d091-6cc4-4b17-bf1e-55b70c1758d5]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:37:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-e63f3aeb-17bf-4f2f-a4a1-48ccd25c8f13 tempest-VolumeQuotasAdminTestJSON-417063872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e303f80d-1557-44ee-bbab-26483eaed649 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:37:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-e63f3aeb-17bf-4f2f-a4a1-48ccd25c8f13 tempest-VolumeQuotasAdminTestJSON-417063872 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e303f80d-1557-44ee-bbab-26483eaed649" returned: 0 in 0.470s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:37:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-e63f3aeb-17bf-4f2f-a4a1-48ccd25c8f13 tempest-VolumeQuotasAdminTestJSON-417063872 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e303f80d-1557-44ee-bbab-26483eaed649 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:37:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-e63f3aeb-17bf-4f2f-a4a1-48ccd25c8f13 tempest-VolumeQuotasAdminTestJSON-417063872 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e303f80d-1557-44ee-bbab-26483eaed649" returned: 0 in 0.133s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:37:59 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-e63f3aeb-17bf-4f2f-a4a1-48ccd25c8f13 tempest-VolumeQuotasAdminTestJSON-417063872 None] Lock "cinder-quobyte-e303f80d-1557-44ee-bbab-26483eaed649" released by "delete_volume" :: held 0.767s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:37:59 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-e63f3aeb-17bf-4f2f-a4a1-48ccd25c8f13 tempest-VolumeQuotasAdminTestJSON-417063872 None] Created reservations ['b112d2ca-d76d-4c5b-9990-01c3f6ffa42f', 'a02ba40c-f384-450b-a3c1-5f0c2b47698c', 'b308517c-f5cb-4dec-a386-0d6cead52937', '6dd55444-afd1-498d-a905-970ec8630aa0'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:37:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-e63f3aeb-17bf-4f2f-a4a1-48ccd25c8f13 tempest-VolumeQuotasAdminTestJSON-417063872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:37:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-e63f3aeb-17bf-4f2f-a4a1-48ccd25c8f13 tempest-VolumeQuotasAdminTestJSON-417063872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:37:59 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-e63f3aeb-17bf-4f2f-a4a1-48ccd25c8f13 tempest-VolumeQuotasAdminTestJSON-417063872 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:37:59 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-e63f3aeb-17bf-4f2f-a4a1-48ccd25c8f13 tempest-VolumeQuotasAdminTestJSON-417063872 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:37:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-e63f3aeb-17bf-4f2f-a4a1-48ccd25c8f13 tempest-VolumeQuotasAdminTestJSON-417063872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:37:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-e63f3aeb-17bf-4f2f-a4a1-48ccd25c8f13 tempest-VolumeQuotasAdminTestJSON-417063872 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:37:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-e63f3aeb-17bf-4f2f-a4a1-48ccd25c8f13 tempest-VolumeQuotasAdminTestJSON-417063872 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.134s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:37:59 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-e63f3aeb-17bf-4f2f-a4a1-48ccd25c8f13 tempest-VolumeQuotasAdminTestJSON-417063872 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:38:00 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-e63f3aeb-17bf-4f2f-a4a1-48ccd25c8f13 tempest-VolumeQuotasAdminTestJSON-417063872 None] Deleted volume successfully.
Sep 18 11:38:00 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-e63f3aeb-17bf-4f2f-a4a1-48ccd25c8f13 tempest-VolumeQuotasAdminTestJSON-417063872 None] Lock "cinder-e303f80d-1557-44ee-bbab-26483eaed649-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:38:09 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=25,cinder:INSERT=11,cinder:UPDATE=27,cinder:DELETE=4 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:38:10 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=30,cinder:UPDATE=61,cinder:INSERT=9,cinder:DELETE=3 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:38:12 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-7f2e75e7-3d15-4d54-b1e3-428fbfd71835 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:38:13 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f2e75e7-3d15-4d54-b1e3-428fbfd71835 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:38:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-7f2e75e7-3d15-4d54-b1e3-428fbfd71835 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Flow 'volume_create_manager' (4f206605-a1e0-497a-8eb4-a4fbe2a7f170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:38:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-7f2e75e7-3d15-4d54-b1e3-428fbfd71835 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f0086fc-7498-403a-91b3-b8eddd7b2035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:38:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-7f2e75e7-3d15-4d54-b1e3-428fbfd71835 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f0086fc-7498-403a-91b3-b8eddd7b2035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:38:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1428059631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33fb5afe-5b47-436c-b7d2-66cf2fed1d57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e04d961753a48ffbdb8e734ef54579d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:38:13Z,use_quota=True,user_id='ff951fe2662b420e986ae5ffba15af30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:38:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-7f2e75e7-3d15-4d54-b1e3-428fbfd71835 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (153d6352-e8b3-42ef-87dd-2f82b9f96d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:38:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-7f2e75e7-3d15-4d54-b1e3-428fbfd71835 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (153d6352-e8b3-42ef-87dd-2f82b9f96d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:38:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-7f2e75e7-3d15-4d54-b1e3-428fbfd71835 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (320d382d-862c-498b-aa8a-e282db13535d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:38:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-7f2e75e7-3d15-4d54-b1e3-428fbfd71835 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (320d382d-862c-498b-aa8a-e282db13535d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33fb5afe-5b47-436c-b7d2-66cf2fed1d57', 'volume_name': 'volume-33fb5afe-5b47-436c-b7d2-66cf2fed1d57', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:38:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-7f2e75e7-3d15-4d54-b1e3-428fbfd71835 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ecbb8db-be97-4f18-aa80-57315f7b772e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:38:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-7f2e75e7-3d15-4d54-b1e3-428fbfd71835 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ecbb8db-be97-4f18-aa80-57315f7b772e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:38:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-7f2e75e7-3d15-4d54-b1e3-428fbfd71835 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18104960-4718-494f-afeb-9561f9ecd95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:38:13 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-7f2e75e7-3d15-4d54-b1e3-428fbfd71835 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Volume 33fb5afe-5b47-436c-b7d2-66cf2fed1d57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33fb5afe-5b47-436c-b7d2-66cf2fed1d57', 'volume_size': 1}
Sep 18 11:38:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-7f2e75e7-3d15-4d54-b1e3-428fbfd71835 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:38:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-7f2e75e7-3d15-4d54-b1e3-428fbfd71835 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:38:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-7f2e75e7-3d15-4d54-b1e3-428fbfd71835 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:38:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1428059631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33fb5afe-5b47-436c-b7d2-66cf2fed1d57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e04d961753a48ffbdb8e734ef54579d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:38:13Z,use_quota=True,user_id='ff951fe2662b420e986ae5ffba15af30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:38:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-7f2e75e7-3d15-4d54-b1e3-428fbfd71835 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Creating volume 33fb5afe-5b47-436c-b7d2-66cf2fed1d57 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:38:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-7f2e75e7-3d15-4d54-b1e3-428fbfd71835 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:38:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-7f2e75e7-3d15-4d54-b1e3-428fbfd71835 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:38:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-7f2e75e7-3d15-4d54-b1e3-428fbfd71835 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:38:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-7f2e75e7-3d15-4d54-b1e3-428fbfd71835 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:38:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-7f2e75e7-3d15-4d54-b1e3-428fbfd71835 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:38:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-7f2e75e7-3d15-4d54-b1e3-428fbfd71835 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:38:13 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-7f2e75e7-3d15-4d54-b1e3-428fbfd71835 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:38:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7f2e75e7-3d15-4d54-b1e3-428fbfd71835 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-33fb5afe-5b47-436c-b7d2-66cf2fed1d57 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:38:13 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=19, name=volume-33fb5afe-5b47-436c-b7d2-66cf2fed1d57, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:38:13 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 11:38:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:38:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:38:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:38:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:38:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:38:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:38:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7f2e75e7-3d15-4d54-b1e3-428fbfd71835 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-33fb5afe-5b47-436c-b7d2-66cf2fed1d57 1073741824" returned: 0 in 0.651s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:38:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7f2e75e7-3d15-4d54-b1e3-428fbfd71835 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-33fb5afe-5b47-436c-b7d2-66cf2fed1d57 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:38:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.428s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:38:14 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:38:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7f2e75e7-3d15-4d54-b1e3-428fbfd71835 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-33fb5afe-5b47-436c-b7d2-66cf2fed1d57" returned: 0 in 0.275s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:38:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-7f2e75e7-3d15-4d54-b1e3-428fbfd71835 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] <== create_volume: return (991ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:38:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-7f2e75e7-3d15-4d54-b1e3-428fbfd71835 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:38:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-7f2e75e7-3d15-4d54-b1e3-428fbfd71835 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18104960-4718-494f-afeb-9561f9ecd95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33fb5afe-5b47-436c-b7d2-66cf2fed1d57', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:38:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-7f2e75e7-3d15-4d54-b1e3-428fbfd71835 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a87ae3b-a4e2-41c7-8c90-71c8aaf33269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:38:14 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-7f2e75e7-3d15-4d54-b1e3-428fbfd71835 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Volume volume-33fb5afe-5b47-436c-b7d2-66cf2fed1d57 (33fb5afe-5b47-436c-b7d2-66cf2fed1d57): created successfully
Sep 18 11:38:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-7f2e75e7-3d15-4d54-b1e3-428fbfd71835 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a87ae3b-a4e2-41c7-8c90-71c8aaf33269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:38:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-7f2e75e7-3d15-4d54-b1e3-428fbfd71835 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Flow 'volume_create_manager' (4f206605-a1e0-497a-8eb4-a4fbe2a7f170) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:38:14 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-7f2e75e7-3d15-4d54-b1e3-428fbfd71835 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Created volume successfully.
Sep 18 11:38:17 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-5a20e734-cace-4f4b-831e-249fe79d38a0 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Acquiring lock "cinder-33fb5afe-5b47-436c-b7d2-66cf2fed1d57-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:38:17 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-5a20e734-cace-4f4b-831e-249fe79d38a0 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Lock "cinder-33fb5afe-5b47-436c-b7d2-66cf2fed1d57-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:38:17 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-5a20e734-cace-4f4b-831e-249fe79d38a0 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:38:17 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-5a20e734-cace-4f4b-831e-249fe79d38a0 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Acquiring lock "cinder-quobyte-33fb5afe-5b47-436c-b7d2-66cf2fed1d57" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:38:17 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-5a20e734-cace-4f4b-831e-249fe79d38a0 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Lock "cinder-quobyte-33fb5afe-5b47-436c-b7d2-66cf2fed1d57" acquired by "delete_volume" :: waited 0.015s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:38:17 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c48015c-b2f0-4f86-a164-b0919df2bf12]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:38:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5a20e734-cace-4f4b-831e-249fe79d38a0 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-33fb5afe-5b47-436c-b7d2-66cf2fed1d57 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:38:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5a20e734-cace-4f4b-831e-249fe79d38a0 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-33fb5afe-5b47-436c-b7d2-66cf2fed1d57" returned: 0 in 0.571s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:38:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5a20e734-cace-4f4b-831e-249fe79d38a0 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-33fb5afe-5b47-436c-b7d2-66cf2fed1d57 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:38:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5a20e734-cace-4f4b-831e-249fe79d38a0 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-33fb5afe-5b47-436c-b7d2-66cf2fed1d57" returned: 0 in 0.165s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:38:18 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-5a20e734-cace-4f4b-831e-249fe79d38a0 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Lock "cinder-quobyte-33fb5afe-5b47-436c-b7d2-66cf2fed1d57" released by "delete_volume" :: held 0.993s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:38:18 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-5a20e734-cace-4f4b-831e-249fe79d38a0 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Created reservations ['cf17b4f5-6c7d-432a-9b45-907d6c08d508', '4ec23ebe-91c4-4b96-b3b0-33c207cb0ac4', '6d9133b9-699a-4b46-8376-c4704486344b', 'b7a166d1-feb9-4c07-91fa-80ffaa557a2f'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:38:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-5a20e734-cace-4f4b-831e-249fe79d38a0 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:38:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-5a20e734-cace-4f4b-831e-249fe79d38a0 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:38:18 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-5a20e734-cace-4f4b-831e-249fe79d38a0 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:38:18 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-5a20e734-cace-4f4b-831e-249fe79d38a0 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:38:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-5a20e734-cace-4f4b-831e-249fe79d38a0 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:38:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5a20e734-cace-4f4b-831e-249fe79d38a0 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:38:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5a20e734-cace-4f4b-831e-249fe79d38a0 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.306s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:38:19 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-5a20e734-cace-4f4b-831e-249fe79d38a0 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:38:19 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-5a20e734-cace-4f4b-831e-249fe79d38a0 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Deleted volume successfully.
Sep 18 11:38:19 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-5a20e734-cace-4f4b-831e-249fe79d38a0 tempest-VolumeQuotasNegativeTestJSON-1253508116 None] Lock "cinder-33fb5afe-5b47-436c-b7d2-66cf2fed1d57-delete_volume" released by "delete_volume" :: held 2.695s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:38:23 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-2462dbd9-9db9-46df-99f8-5791099764a6 tempest-AttachVolumeNegativeTest-652039892 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:38:23 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-2462dbd9-9db9-46df-99f8-5791099764a6 tempest-AttachVolumeNegativeTest-652039892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:38:23 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2462dbd9-9db9-46df-99f8-5791099764a6 tempest-AttachVolumeNegativeTest-652039892 None] Flow 'volume_create_manager' (a650eabc-d92b-400f-bdc5-e91a2a4229a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:38:23 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2462dbd9-9db9-46df-99f8-5791099764a6 tempest-AttachVolumeNegativeTest-652039892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f01a0cab-d90a-4bf8-91ef-3802cadd4b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:38:23 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2462dbd9-9db9-46df-99f8-5791099764a6 tempest-AttachVolumeNegativeTest-652039892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f01a0cab-d90a-4bf8-91ef-3802cadd4b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-287364372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b84b74c-432d-450c-b80a-00b3a9652c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a05d56cebf4a648f8e1448c266b3a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:38:24Z,use_quota=True,user_id='601cfe954e21466cb2aa683fe69a2b53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:38:23 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2462dbd9-9db9-46df-99f8-5791099764a6 tempest-AttachVolumeNegativeTest-652039892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b5eee0e-b7a1-4ecc-8925-9fbd182ba4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:38:24 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2462dbd9-9db9-46df-99f8-5791099764a6 tempest-AttachVolumeNegativeTest-652039892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b5eee0e-b7a1-4ecc-8925-9fbd182ba4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:38:24 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2462dbd9-9db9-46df-99f8-5791099764a6 tempest-AttachVolumeNegativeTest-652039892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (560c7539-27ab-401e-8d8b-960409f87908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:38:24 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2462dbd9-9db9-46df-99f8-5791099764a6 tempest-AttachVolumeNegativeTest-652039892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (560c7539-27ab-401e-8d8b-960409f87908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b84b74c-432d-450c-b80a-00b3a9652c48', 'volume_name': 'volume-5b84b74c-432d-450c-b80a-00b3a9652c48', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:38:24 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2462dbd9-9db9-46df-99f8-5791099764a6 tempest-AttachVolumeNegativeTest-652039892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40e45026-3036-4e63-9d13-4aca13c6aa33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:38:24 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2462dbd9-9db9-46df-99f8-5791099764a6 tempest-AttachVolumeNegativeTest-652039892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40e45026-3036-4e63-9d13-4aca13c6aa33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:38:24 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2462dbd9-9db9-46df-99f8-5791099764a6 tempest-AttachVolumeNegativeTest-652039892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5c95b5-d5a4-4e03-af77-9bf5e2868d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:38:24 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-2462dbd9-9db9-46df-99f8-5791099764a6 tempest-AttachVolumeNegativeTest-652039892 None] Volume 5b84b74c-432d-450c-b80a-00b3a9652c48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b84b74c-432d-450c-b80a-00b3a9652c48', 'volume_size': 1}
Sep 18 11:38:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-2462dbd9-9db9-46df-99f8-5791099764a6 tempest-AttachVolumeNegativeTest-652039892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:38:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-2462dbd9-9db9-46df-99f8-5791099764a6 tempest-AttachVolumeNegativeTest-652039892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:38:24 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-2462dbd9-9db9-46df-99f8-5791099764a6 tempest-AttachVolumeNegativeTest-652039892 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-287364372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b84b74c-432d-450c-b80a-00b3a9652c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a05d56cebf4a648f8e1448c266b3a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:38:24Z,use_quota=True,user_id='601cfe954e21466cb2aa683fe69a2b53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:38:24 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-2462dbd9-9db9-46df-99f8-5791099764a6 tempest-AttachVolumeNegativeTest-652039892 None] Creating volume 5b84b74c-432d-450c-b80a-00b3a9652c48 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:38:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-2462dbd9-9db9-46df-99f8-5791099764a6 tempest-AttachVolumeNegativeTest-652039892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:38:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-2462dbd9-9db9-46df-99f8-5791099764a6 tempest-AttachVolumeNegativeTest-652039892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:38:24 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-2462dbd9-9db9-46df-99f8-5791099764a6 tempest-AttachVolumeNegativeTest-652039892 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:38:24 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-2462dbd9-9db9-46df-99f8-5791099764a6 tempest-AttachVolumeNegativeTest-652039892 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:38:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-2462dbd9-9db9-46df-99f8-5791099764a6 tempest-AttachVolumeNegativeTest-652039892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:38:24 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-2462dbd9-9db9-46df-99f8-5791099764a6 tempest-AttachVolumeNegativeTest-652039892 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:38:24 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-2462dbd9-9db9-46df-99f8-5791099764a6 tempest-AttachVolumeNegativeTest-652039892 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:38:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2462dbd9-9db9-46df-99f8-5791099764a6 tempest-AttachVolumeNegativeTest-652039892 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5b84b74c-432d-450c-b80a-00b3a9652c48 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:38:24 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=20, name=volume-5b84b74c-432d-450c-b80a-00b3a9652c48, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:38:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2462dbd9-9db9-46df-99f8-5791099764a6 tempest-AttachVolumeNegativeTest-652039892 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5b84b74c-432d-450c-b80a-00b3a9652c48 1073741824" returned: 0 in 0.526s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:38:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2462dbd9-9db9-46df-99f8-5791099764a6 tempest-AttachVolumeNegativeTest-652039892 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5b84b74c-432d-450c-b80a-00b3a9652c48 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:38:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2462dbd9-9db9-46df-99f8-5791099764a6 tempest-AttachVolumeNegativeTest-652039892 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5b84b74c-432d-450c-b80a-00b3a9652c48" returned: 0 in 0.191s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:38:24 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-2462dbd9-9db9-46df-99f8-5791099764a6 tempest-AttachVolumeNegativeTest-652039892 None] <== create_volume: return (838ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:38:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-2462dbd9-9db9-46df-99f8-5791099764a6 tempest-AttachVolumeNegativeTest-652039892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:38:25 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2462dbd9-9db9-46df-99f8-5791099764a6 tempest-AttachVolumeNegativeTest-652039892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5c95b5-d5a4-4e03-af77-9bf5e2868d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b84b74c-432d-450c-b80a-00b3a9652c48', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:38:25 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2462dbd9-9db9-46df-99f8-5791099764a6 tempest-AttachVolumeNegativeTest-652039892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eec046d-5166-44f7-86ec-ab145598478e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:38:25 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-2462dbd9-9db9-46df-99f8-5791099764a6 tempest-AttachVolumeNegativeTest-652039892 None] Volume volume-5b84b74c-432d-450c-b80a-00b3a9652c48 (5b84b74c-432d-450c-b80a-00b3a9652c48): created successfully
Sep 18 11:38:25 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2462dbd9-9db9-46df-99f8-5791099764a6 tempest-AttachVolumeNegativeTest-652039892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eec046d-5166-44f7-86ec-ab145598478e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:38:25 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2462dbd9-9db9-46df-99f8-5791099764a6 tempest-AttachVolumeNegativeTest-652039892 None] Flow 'volume_create_manager' (a650eabc-d92b-400f-bdc5-e91a2a4229a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:38:25 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-2462dbd9-9db9-46df-99f8-5791099764a6 tempest-AttachVolumeNegativeTest-652039892 None] Created volume successfully.
Sep 18 11:38:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-999e6de8-6155-4c21-a040-52fd064c6864 req-c09b0479-1e0f-47a3-8be2-6d10bd4a0e1d tempest-AttachVolumeNegativeTest-652039892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:38:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-999e6de8-6155-4c21-a040-52fd064c6864 req-c09b0479-1e0f-47a3-8be2-6d10bd4a0e1d tempest-AttachVolumeNegativeTest-652039892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:38:29 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa686e06-c3a0-44bb-b911-ab391cab1184]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:38:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-999e6de8-6155-4c21-a040-52fd064c6864 req-c09b0479-1e0f-47a3-8be2-6d10bd4a0e1d tempest-AttachVolumeNegativeTest-652039892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5b84b74c-432d-450c-b80a-00b3a9652c48 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:38:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-999e6de8-6155-4c21-a040-52fd064c6864 req-c09b0479-1e0f-47a3-8be2-6d10bd4a0e1d tempest-AttachVolumeNegativeTest-652039892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5b84b74c-432d-450c-b80a-00b3a9652c48" returned: 0 in 0.760s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:38:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-999e6de8-6155-4c21-a040-52fd064c6864 req-c09b0479-1e0f-47a3-8be2-6d10bd4a0e1d tempest-AttachVolumeNegativeTest-652039892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.805s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:38:30 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-93b6d22d-3ce1-43ed-823b-b64ebae97744 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:38:30 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-93b6d22d-3ce1-43ed-823b-b64ebae97744 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:38:30 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-93b6d22d-3ce1-43ed-823b-b64ebae97744 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Flow 'volume_create_manager' (e853f270-c29b-4fae-8817-1e08207fc580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:38:30 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-93b6d22d-3ce1-43ed-823b-b64ebae97744 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8748bdac-8741-4170-adfe-ef60eeb10b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:38:30 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-999e6de8-6155-4c21-a040-52fd064c6864 req-c09b0479-1e0f-47a3-8be2-6d10bd4a0e1d tempest-AttachVolumeNegativeTest-652039892 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8', 'name': 'volume-5b84b74c-432d-450c-b80a-00b3a9652c48', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '67f18b6a-2d24-4c1f-a84d-3cd636d3f4fc', 'enforce_multipath': True} {{(pid=83176) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 11:38:30 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-999e6de8-6155-4c21-a040-52fd064c6864 req-c09b0479-1e0f-47a3-8be2-6d10bd4a0e1d tempest-AttachVolumeNegativeTest-652039892 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:38:31 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-93b6d22d-3ce1-43ed-823b-b64ebae97744 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8748bdac-8741-4170-adfe-ef60eeb10b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-370992307',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ee13d2c-2165-4310-9393-9c6cc37aae25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8b310e05b494318b0047a8da51328ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:38:30Z,use_quota=True,user_id='46a27f24f50d4fbdbe036a0ab7919e32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:38:31 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-93b6d22d-3ce1-43ed-823b-b64ebae97744 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53bc138c-9c36-459d-be38-e835ef8f46b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:38:31 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-93b6d22d-3ce1-43ed-823b-b64ebae97744 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53bc138c-9c36-459d-be38-e835ef8f46b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:38:31 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-93b6d22d-3ce1-43ed-823b-b64ebae97744 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0c29a71-2738-4436-8c03-7f079ff57385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:38:31 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-93b6d22d-3ce1-43ed-823b-b64ebae97744 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0c29a71-2738-4436-8c03-7f079ff57385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ee13d2c-2165-4310-9393-9c6cc37aae25', 'volume_name': 'volume-8ee13d2c-2165-4310-9393-9c6cc37aae25', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:38:31 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-93b6d22d-3ce1-43ed-823b-b64ebae97744 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18693678-dec6-47d0-a9b0-b5dc816bbda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:38:31 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-93b6d22d-3ce1-43ed-823b-b64ebae97744 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18693678-dec6-47d0-a9b0-b5dc816bbda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:38:31 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-93b6d22d-3ce1-43ed-823b-b64ebae97744 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b93daf4e-6edc-4de4-b261-1fa389fe0ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:38:31 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-93b6d22d-3ce1-43ed-823b-b64ebae97744 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Volume 8ee13d2c-2165-4310-9393-9c6cc37aae25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ee13d2c-2165-4310-9393-9c6cc37aae25', 'volume_size': 1}
Sep 18 11:38:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-93b6d22d-3ce1-43ed-823b-b64ebae97744 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:38:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-93b6d22d-3ce1-43ed-823b-b64ebae97744 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:38:31 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-93b6d22d-3ce1-43ed-823b-b64ebae97744 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-370992307',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ee13d2c-2165-4310-9393-9c6cc37aae25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8b310e05b494318b0047a8da51328ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:38:30Z,use_quota=True,user_id='46a27f24f50d4fbdbe036a0ab7919e32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:38:31 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-93b6d22d-3ce1-43ed-823b-b64ebae97744 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Creating volume 8ee13d2c-2165-4310-9393-9c6cc37aae25 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:38:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-93b6d22d-3ce1-43ed-823b-b64ebae97744 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:38:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-93b6d22d-3ce1-43ed-823b-b64ebae97744 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:38:31 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-93b6d22d-3ce1-43ed-823b-b64ebae97744 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:38:31 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-93b6d22d-3ce1-43ed-823b-b64ebae97744 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:38:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-93b6d22d-3ce1-43ed-823b-b64ebae97744 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:38:31 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-93b6d22d-3ce1-43ed-823b-b64ebae97744 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:38:31 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-93b6d22d-3ce1-43ed-823b-b64ebae97744 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:38:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-93b6d22d-3ce1-43ed-823b-b64ebae97744 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8ee13d2c-2165-4310-9393-9c6cc37aae25 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:38:31 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=21, name=volume-8ee13d2c-2165-4310-9393-9c6cc37aae25, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:38:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-93b6d22d-3ce1-43ed-823b-b64ebae97744 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8ee13d2c-2165-4310-9393-9c6cc37aae25 1073741824" returned: 0 in 0.427s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:38:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-93b6d22d-3ce1-43ed-823b-b64ebae97744 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8ee13d2c-2165-4310-9393-9c6cc37aae25 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:38:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-93b6d22d-3ce1-43ed-823b-b64ebae97744 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8ee13d2c-2165-4310-9393-9c6cc37aae25" returned: 0 in 0.340s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:38:31 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-93b6d22d-3ce1-43ed-823b-b64ebae97744 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] <== create_volume: return (837ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:38:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-93b6d22d-3ce1-43ed-823b-b64ebae97744 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:38:31 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-999e6de8-6155-4c21-a040-52fd064c6864 req-c09b0479-1e0f-47a3-8be2-6d10bd4a0e1d tempest-AttachVolumeNegativeTest-652039892 None] attachment_update completed successfully.
Sep 18 11:38:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-93b6d22d-3ce1-43ed-823b-b64ebae97744 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b93daf4e-6edc-4de4-b261-1fa389fe0ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ee13d2c-2165-4310-9393-9c6cc37aae25', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:38:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-93b6d22d-3ce1-43ed-823b-b64ebae97744 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcdb0b2c-64a9-4e42-a62b-ac50f475f39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:38:32 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-93b6d22d-3ce1-43ed-823b-b64ebae97744 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Volume volume-8ee13d2c-2165-4310-9393-9c6cc37aae25 (8ee13d2c-2165-4310-9393-9c6cc37aae25): created successfully
Sep 18 11:38:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-93b6d22d-3ce1-43ed-823b-b64ebae97744 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcdb0b2c-64a9-4e42-a62b-ac50f475f39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:38:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-93b6d22d-3ce1-43ed-823b-b64ebae97744 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Flow 'volume_create_manager' (e853f270-c29b-4fae-8817-1e08207fc580) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:38:32 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-93b6d22d-3ce1-43ed-823b-b64ebae97744 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Created volume successfully.
Sep 18 11:38:33 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-979d9d9a-5f3e-4f1d-9217-6b921dd7ac03 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:38:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-979d9d9a-5f3e-4f1d-9217-6b921dd7ac03 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:38:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-979d9d9a-5f3e-4f1d-9217-6b921dd7ac03 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:38:33 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-979d9d9a-5f3e-4f1d-9217-6b921dd7ac03 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Creating offline snapshot f8aa6025-b97f-43bd-a868-5a83134801c4 of volume 8ee13d2c-2165-4310-9393-9c6cc37aae25 {{(pid=83176) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 11:38:33 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[628989a6-0d30-49fa-91d5-adc7daaa5f96]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:38:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-979d9d9a-5f3e-4f1d-9217-6b921dd7ac03 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8ee13d2c-2165-4310-9393-9c6cc37aae25 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:38:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-979d9d9a-5f3e-4f1d-9217-6b921dd7ac03 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8ee13d2c-2165-4310-9393-9c6cc37aae25" returned: 0 in 0.794s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:38:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-979d9d9a-5f3e-4f1d-9217-6b921dd7ac03 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8ee13d2c-2165-4310-9393-9c6cc37aae25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8ee13d2c-2165-4310-9393-9c6cc37aae25.f8aa6025-b97f-43bd-a868-5a83134801c4 1G {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:38:34 devstack quobyte-client[83193]: System call of process 90078 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:38:34 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=22, name=volume-8ee13d2c-2165-4310-9393-9c6cc37aae25.f8aa6025-b97f-43bd-a868-5a83134801c4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:38:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-979d9d9a-5f3e-4f1d-9217-6b921dd7ac03 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8ee13d2c-2165-4310-9393-9c6cc37aae25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8ee13d2c-2165-4310-9393-9c6cc37aae25.f8aa6025-b97f-43bd-a868-5a83134801c4 1G" returned: 0 in 0.503s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:38:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-979d9d9a-5f3e-4f1d-9217-6b921dd7ac03 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Running cmd (subprocess): qemu-img rebase -u -b volume-8ee13d2c-2165-4310-9393-9c6cc37aae25 -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8ee13d2c-2165-4310-9393-9c6cc37aae25.f8aa6025-b97f-43bd-a868-5a83134801c4 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:38:35 devstack quobyte-client[83193]: System call of process 90085 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:38:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-979d9d9a-5f3e-4f1d-9217-6b921dd7ac03 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] CMD "qemu-img rebase -u -b volume-8ee13d2c-2165-4310-9393-9c6cc37aae25 -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8ee13d2c-2165-4310-9393-9c6cc37aae25.f8aa6025-b97f-43bd-a868-5a83134801c4" returned: 0 in 0.268s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:38:35 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-979d9d9a-5f3e-4f1d-9217-6b921dd7ac03 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8ee13d2c-2165-4310-9393-9c6cc37aae25.f8aa6025-b97f-43bd-a868-5a83134801c4 is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 11:38:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-979d9d9a-5f3e-4f1d-9217-6b921dd7ac03 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8ee13d2c-2165-4310-9393-9c6cc37aae25.f8aa6025-b97f-43bd-a868-5a83134801c4 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:38:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-979d9d9a-5f3e-4f1d-9217-6b921dd7ac03 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8ee13d2c-2165-4310-9393-9c6cc37aae25.f8aa6025-b97f-43bd-a868-5a83134801c4" returned: 0 in 0.265s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:38:35 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-979d9d9a-5f3e-4f1d-9217-6b921dd7ac03 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Setting permissions: /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8ee13d2c-2165-4310-9393-9c6cc37aae25 -> 1000:1000 {{(pid=83176) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 11:38:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-979d9d9a-5f3e-4f1d-9217-6b921dd7ac03 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8ee13d2c-2165-4310-9393-9c6cc37aae25 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8ee13d2c-2165-4310-9393-9c6cc37aae25.f8aa6025-b97f-43bd-a868-5a83134801c4 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:38:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-979d9d9a-5f3e-4f1d-9217-6b921dd7ac03 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8ee13d2c-2165-4310-9393-9c6cc37aae25 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8ee13d2c-2165-4310-9393-9c6cc37aae25.f8aa6025-b97f-43bd-a868-5a83134801c4" returned: 0 in 0.280s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:38:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-979d9d9a-5f3e-4f1d-9217-6b921dd7ac03 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8ee13d2c-2165-4310-9393-9c6cc37aae25.info {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:38:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-979d9d9a-5f3e-4f1d-9217-6b921dd7ac03 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8ee13d2c-2165-4310-9393-9c6cc37aae25.info" returned: 0 in 0.168s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:38:36 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-979d9d9a-5f3e-4f1d-9217-6b921dd7ac03 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8ee13d2c-2165-4310-9393-9c6cc37aae25.info is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 11:38:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-979d9d9a-5f3e-4f1d-9217-6b921dd7ac03 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8ee13d2c-2165-4310-9393-9c6cc37aae25.info {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:38:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-979d9d9a-5f3e-4f1d-9217-6b921dd7ac03 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8ee13d2c-2165-4310-9393-9c6cc37aae25.info" returned: 0 in 0.180s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:38:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-979d9d9a-5f3e-4f1d-9217-6b921dd7ac03 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.356s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:38:37 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-979d9d9a-5f3e-4f1d-9217-6b921dd7ac03 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Create snapshot completed successfully
Sep 18 11:38:39 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-3bb2c255-131c-45c2-9a7c-964b597e5646 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Acquiring lock "cinder-f8aa6025-b97f-43bd-a868-5a83134801c4-delete_snapshot" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:38:39 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-3bb2c255-131c-45c2-9a7c-964b597e5646 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Lock "cinder-f8aa6025-b97f-43bd-a868-5a83134801c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.123s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:38:39 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-3bb2c255-131c-45c2-9a7c-964b597e5646 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:38:39 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-3bb2c255-131c-45c2-9a7c-964b597e5646 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Acquiring lock "cinder-quobyte-8ee13d2c-2165-4310-9393-9c6cc37aae25" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:38:39 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-3bb2c255-131c-45c2-9a7c-964b597e5646 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Lock "cinder-quobyte-8ee13d2c-2165-4310-9393-9c6cc37aae25" acquired by "delete_snapshot" :: waited 0.095s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:38:39 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-3bb2c255-131c-45c2-9a7c-964b597e5646 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Acquiring lock "cinder-quobyte-f8aa6025-b97f-43bd-a868-5a83134801c4" by "_delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:38:39 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-3bb2c255-131c-45c2-9a7c-964b597e5646 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Lock "cinder-quobyte-f8aa6025-b97f-43bd-a868-5a83134801c4" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:38:39 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-3bb2c255-131c-45c2-9a7c-964b597e5646 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Deleting offline snapshot f8aa6025-b97f-43bd-a868-5a83134801c4 of volume 8ee13d2c-2165-4310-9393-9c6cc37aae25 {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 11:38:39 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-3bb2c255-131c-45c2-9a7c-964b597e5646 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] snapshot_file for this snap is: volume-8ee13d2c-2165-4310-9393-9c6cc37aae25.f8aa6025-b97f-43bd-a868-5a83134801c4 {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 11:38:39 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[640cc6e0-167c-4bfc-9297-2b4d867ef749]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:38:39 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-3bb2c255-131c-45c2-9a7c-964b597e5646 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8ee13d2c-2165-4310-9393-9c6cc37aae25.f8aa6025-b97f-43bd-a868-5a83134801c4 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:38:40 devstack quobyte-client[83193]: System call of process 90111 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:38:40 devstack quobyte-client[83193]: System call of process 90111 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:38:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-3bb2c255-131c-45c2-9a7c-964b597e5646 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8ee13d2c-2165-4310-9393-9c6cc37aae25.f8aa6025-b97f-43bd-a868-5a83134801c4" returned: 0 in 0.749s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:38:40 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-3bb2c255-131c-45c2-9a7c-964b597e5646 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ee13d2c-2165-4310-9393-9c6cc37aae25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 11:38:40 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[598c5ea3-bd62-4bd6-903e-ce7a178a9f79]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:38:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-3bb2c255-131c-45c2-9a7c-964b597e5646 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8ee13d2c-2165-4310-9393-9c6cc37aae25 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:38:41 devstack quobyte-client[83193]: System call of process 90118 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:38:41 devstack quobyte-client[83193]: System call of process 90118 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:38:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-3bb2c255-131c-45c2-9a7c-964b597e5646 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8ee13d2c-2165-4310-9393-9c6cc37aae25" returned: 0 in 0.849s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:38:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-3bb2c255-131c-45c2-9a7c-964b597e5646 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8ee13d2c-2165-4310-9393-9c6cc37aae25.f8aa6025-b97f-43bd-a868-5a83134801c4 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:38:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-3bb2c255-131c-45c2-9a7c-964b597e5646 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8ee13d2c-2165-4310-9393-9c6cc37aae25.f8aa6025-b97f-43bd-a868-5a83134801c4" returned: 0 in 0.545s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:38:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-3bb2c255-131c-45c2-9a7c-964b597e5646 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8ee13d2c-2165-4310-9393-9c6cc37aae25.f8aa6025-b97f-43bd-a868-5a83134801c4 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:38:42 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-3bb2c255-131c-45c2-9a7c-964b597e5646 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8ee13d2c-2165-4310-9393-9c6cc37aae25.f8aa6025-b97f-43bd-a868-5a83134801c4" returned: 0 in 0.140s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:38:42 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-3bb2c255-131c-45c2-9a7c-964b597e5646 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Lock "cinder-quobyte-f8aa6025-b97f-43bd-a868-5a83134801c4" released by "_delete_snapshot" :: held 2.851s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:38:42 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-3bb2c255-131c-45c2-9a7c-964b597e5646 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Lock "cinder-quobyte-8ee13d2c-2165-4310-9393-9c6cc37aae25" released by "delete_snapshot" :: held 2.887s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:38:43 devstack cinder-volume[83176]: WARNING cinder.quota [None req-3bb2c255-131c-45c2-9a7c-964b597e5646 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 18 11:38:43 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-3bb2c255-131c-45c2-9a7c-964b597e5646 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Created reservations ['c2396246-656c-479b-8537-7a9114547666', '0eca337f-30ec-4fac-80e6-6d358bfe814a', 'ffa8b0f1-ab49-459d-b37d-fcb1658ab813', 'b8c64d2d-432b-41ca-8357-73366943dafb'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:38:43 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-3bb2c255-131c-45c2-9a7c-964b597e5646 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Delete snapshot completed successfully.
Sep 18 11:38:43 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-3bb2c255-131c-45c2-9a7c-964b597e5646 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Lock "cinder-f8aa6025-b97f-43bd-a868-5a83134801c4-delete_snapshot" released by "delete_snapshot" :: held 4.438s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:38:44 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-06e0120b-b54e-46d9-9b6c-83562dacc5a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Acquiring lock "cinder-8ee13d2c-2165-4310-9393-9c6cc37aae25-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:38:44 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-06e0120b-b54e-46d9-9b6c-83562dacc5a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Lock "cinder-8ee13d2c-2165-4310-9393-9c6cc37aae25-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:38:44 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-06e0120b-b54e-46d9-9b6c-83562dacc5a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:38:44 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-06e0120b-b54e-46d9-9b6c-83562dacc5a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Acquiring lock "cinder-quobyte-8ee13d2c-2165-4310-9393-9c6cc37aae25" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:38:44 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-06e0120b-b54e-46d9-9b6c-83562dacc5a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Lock "cinder-quobyte-8ee13d2c-2165-4310-9393-9c6cc37aae25" acquired by "delete_volume" :: waited 0.018s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:38:45 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a22f943-d286-4db4-a055-45ec0bf8d6d8]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:38:45 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-06e0120b-b54e-46d9-9b6c-83562dacc5a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8ee13d2c-2165-4310-9393-9c6cc37aae25 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:38:45 devstack quobyte-client[83193]: System call of process 90129 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:38:46 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-06e0120b-b54e-46d9-9b6c-83562dacc5a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8ee13d2c-2165-4310-9393-9c6cc37aae25" returned: 0 in 0.918s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:38:46 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-06e0120b-b54e-46d9-9b6c-83562dacc5a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8ee13d2c-2165-4310-9393-9c6cc37aae25 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:38:46 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-06e0120b-b54e-46d9-9b6c-83562dacc5a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8ee13d2c-2165-4310-9393-9c6cc37aae25" returned: 0 in 0.290s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:38:46 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-06e0120b-b54e-46d9-9b6c-83562dacc5a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Lock "cinder-quobyte-8ee13d2c-2165-4310-9393-9c6cc37aae25" released by "delete_volume" :: held 1.574s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:38:47 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-06e0120b-b54e-46d9-9b6c-83562dacc5a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Created reservations ['c7468504-effd-47ca-9369-fa9b1149e2a3', '55cccb9f-1900-46c0-ac9a-2064f29ea84e', 'e7ad6d2d-3711-423a-86d1-807892c42074', 'a5ba04a8-3ea2-4661-afc0-362b7aa1f42d'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:38:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-06e0120b-b54e-46d9-9b6c-83562dacc5a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:38:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-06e0120b-b54e-46d9-9b6c-83562dacc5a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:38:47 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-06e0120b-b54e-46d9-9b6c-83562dacc5a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:38:47 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-06e0120b-b54e-46d9-9b6c-83562dacc5a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:38:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-06e0120b-b54e-46d9-9b6c-83562dacc5a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:38:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-06e0120b-b54e-46d9-9b6c-83562dacc5a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:38:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-06e0120b-b54e-46d9-9b6c-83562dacc5a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.168s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:38:47 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-06e0120b-b54e-46d9-9b6c-83562dacc5a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:38:47 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-06e0120b-b54e-46d9-9b6c-83562dacc5a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Deleted volume successfully.
Sep 18 11:38:48 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-06e0120b-b54e-46d9-9b6c-83562dacc5a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-951438105 None] Lock "cinder-8ee13d2c-2165-4310-9393-9c6cc37aae25-delete_volume" released by "delete_volume" :: held 3.371s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:38:57 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=24,cinder:UPDATE=29,cinder:DELETE=2,cinder:INSERT=5 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:38:58 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:UPDATE=32,cinder:SELECT=26,cinder:DELETE=4,cinder:INSERT=7 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:39:06 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-9812413f-3bc3-44c9-92bb-5bdc955370f5 tempest-VolumesListAdminTestJSON-1583005234 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:39:06 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-9812413f-3bc3-44c9-92bb-5bdc955370f5 tempest-VolumesListAdminTestJSON-1583005234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:39:06 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9812413f-3bc3-44c9-92bb-5bdc955370f5 tempest-VolumesListAdminTestJSON-1583005234 None] Flow 'volume_create_manager' (37313ec1-b572-49eb-8482-fb99d5eccf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:39:06 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9812413f-3bc3-44c9-92bb-5bdc955370f5 tempest-VolumesListAdminTestJSON-1583005234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34871077-0fca-4ce9-ba73-5f10e0c7d9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:39:06 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9812413f-3bc3-44c9-92bb-5bdc955370f5 tempest-VolumesListAdminTestJSON-1583005234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34871077-0fca-4ce9-ba73-5f10e0c7d9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1577028042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27cb56eb-3f59-4c6e-8a61-97de7e6035c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='911ef021a4f24a7789532dcd65d10ce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:39:06Z,use_quota=True,user_id='093bfc5555254ebe9ed67673234bffbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:39:06 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9812413f-3bc3-44c9-92bb-5bdc955370f5 tempest-VolumesListAdminTestJSON-1583005234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (549bae26-2c6e-4759-a9e1-59a13a511d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:39:06 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9812413f-3bc3-44c9-92bb-5bdc955370f5 tempest-VolumesListAdminTestJSON-1583005234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (549bae26-2c6e-4759-a9e1-59a13a511d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:39:06 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9812413f-3bc3-44c9-92bb-5bdc955370f5 tempest-VolumesListAdminTestJSON-1583005234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40ed92ea-be35-4ff3-a67e-61f263f88b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:39:06 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9812413f-3bc3-44c9-92bb-5bdc955370f5 tempest-VolumesListAdminTestJSON-1583005234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40ed92ea-be35-4ff3-a67e-61f263f88b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27cb56eb-3f59-4c6e-8a61-97de7e6035c1', 'volume_name': 'volume-27cb56eb-3f59-4c6e-8a61-97de7e6035c1', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:39:06 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9812413f-3bc3-44c9-92bb-5bdc955370f5 tempest-VolumesListAdminTestJSON-1583005234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00c3e2a0-3c94-48b3-847b-8737360dd5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:39:06 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9812413f-3bc3-44c9-92bb-5bdc955370f5 tempest-VolumesListAdminTestJSON-1583005234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00c3e2a0-3c94-48b3-847b-8737360dd5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:39:06 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9812413f-3bc3-44c9-92bb-5bdc955370f5 tempest-VolumesListAdminTestJSON-1583005234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97cb7717-9a9b-45cd-a823-6ae26d871068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:39:06 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-9812413f-3bc3-44c9-92bb-5bdc955370f5 tempest-VolumesListAdminTestJSON-1583005234 None] Volume 27cb56eb-3f59-4c6e-8a61-97de7e6035c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27cb56eb-3f59-4c6e-8a61-97de7e6035c1', 'volume_size': 1}
Sep 18 11:39:06 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-9812413f-3bc3-44c9-92bb-5bdc955370f5 tempest-VolumesListAdminTestJSON-1583005234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:39:06 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-9812413f-3bc3-44c9-92bb-5bdc955370f5 tempest-VolumesListAdminTestJSON-1583005234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:39:06 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-9812413f-3bc3-44c9-92bb-5bdc955370f5 tempest-VolumesListAdminTestJSON-1583005234 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1577028042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27cb56eb-3f59-4c6e-8a61-97de7e6035c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='911ef021a4f24a7789532dcd65d10ce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:39:06Z,use_quota=True,user_id='093bfc5555254ebe9ed67673234bffbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:39:06 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-9812413f-3bc3-44c9-92bb-5bdc955370f5 tempest-VolumesListAdminTestJSON-1583005234 None] Creating volume 27cb56eb-3f59-4c6e-8a61-97de7e6035c1 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:39:06 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-9812413f-3bc3-44c9-92bb-5bdc955370f5 tempest-VolumesListAdminTestJSON-1583005234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:39:06 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-9812413f-3bc3-44c9-92bb-5bdc955370f5 tempest-VolumesListAdminTestJSON-1583005234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:39:06 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-9812413f-3bc3-44c9-92bb-5bdc955370f5 tempest-VolumesListAdminTestJSON-1583005234 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:39:06 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-9812413f-3bc3-44c9-92bb-5bdc955370f5 tempest-VolumesListAdminTestJSON-1583005234 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:39:06 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-9812413f-3bc3-44c9-92bb-5bdc955370f5 tempest-VolumesListAdminTestJSON-1583005234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:39:06 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-9812413f-3bc3-44c9-92bb-5bdc955370f5 tempest-VolumesListAdminTestJSON-1583005234 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:39:06 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-9812413f-3bc3-44c9-92bb-5bdc955370f5 tempest-VolumesListAdminTestJSON-1583005234 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:39:06 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9812413f-3bc3-44c9-92bb-5bdc955370f5 tempest-VolumesListAdminTestJSON-1583005234 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-27cb56eb-3f59-4c6e-8a61-97de7e6035c1 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:39:07 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=24, name=volume-27cb56eb-3f59-4c6e-8a61-97de7e6035c1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:39:07 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9812413f-3bc3-44c9-92bb-5bdc955370f5 tempest-VolumesListAdminTestJSON-1583005234 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-27cb56eb-3f59-4c6e-8a61-97de7e6035c1 1073741824" returned: 0 in 0.588s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:39:07 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9812413f-3bc3-44c9-92bb-5bdc955370f5 tempest-VolumesListAdminTestJSON-1583005234 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-27cb56eb-3f59-4c6e-8a61-97de7e6035c1 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:39:07 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9812413f-3bc3-44c9-92bb-5bdc955370f5 tempest-VolumesListAdminTestJSON-1583005234 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-27cb56eb-3f59-4c6e-8a61-97de7e6035c1" returned: 0 in 0.240s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:39:07 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-9812413f-3bc3-44c9-92bb-5bdc955370f5 tempest-VolumesListAdminTestJSON-1583005234 None] <== create_volume: return (983ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:39:07 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-9812413f-3bc3-44c9-92bb-5bdc955370f5 tempest-VolumesListAdminTestJSON-1583005234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:39:08 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9812413f-3bc3-44c9-92bb-5bdc955370f5 tempest-VolumesListAdminTestJSON-1583005234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97cb7717-9a9b-45cd-a823-6ae26d871068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27cb56eb-3f59-4c6e-8a61-97de7e6035c1', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:39:08 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9812413f-3bc3-44c9-92bb-5bdc955370f5 tempest-VolumesListAdminTestJSON-1583005234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b46c0764-c9a2-4b28-9a24-6cc9e1fce330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:39:08 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-9812413f-3bc3-44c9-92bb-5bdc955370f5 tempest-VolumesListAdminTestJSON-1583005234 None] Volume volume-27cb56eb-3f59-4c6e-8a61-97de7e6035c1 (27cb56eb-3f59-4c6e-8a61-97de7e6035c1): created successfully
Sep 18 11:39:08 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9812413f-3bc3-44c9-92bb-5bdc955370f5 tempest-VolumesListAdminTestJSON-1583005234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b46c0764-c9a2-4b28-9a24-6cc9e1fce330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:39:08 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9812413f-3bc3-44c9-92bb-5bdc955370f5 tempest-VolumesListAdminTestJSON-1583005234 None] Flow 'volume_create_manager' (37313ec1-b572-49eb-8482-fb99d5eccf0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:39:08 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-9812413f-3bc3-44c9-92bb-5bdc955370f5 tempest-VolumesListAdminTestJSON-1583005234 None] Created volume successfully.
Sep 18 11:39:10 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-59d28be3-c691-4641-b702-0681579d894e tempest-VolumesListAdminTestJSON-1583005234 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:39:10 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-59d28be3-c691-4641-b702-0681579d894e tempest-VolumesListAdminTestJSON-1583005234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:39:10 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-59d28be3-c691-4641-b702-0681579d894e tempest-VolumesListAdminTestJSON-1583005234 None] Flow 'volume_create_manager' (1b755dcf-b08a-4a90-85b9-b78af8f1ea8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:39:10 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-59d28be3-c691-4641-b702-0681579d894e tempest-VolumesListAdminTestJSON-1583005234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e197d93-78d3-4087-a59b-e2f7935bfdf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:39:10 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-59d28be3-c691-4641-b702-0681579d894e tempest-VolumesListAdminTestJSON-1583005234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e197d93-78d3-4087-a59b-e2f7935bfdf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1032087950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1cec6c4-cf26-49fd-8c21-78100db0c199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='911ef021a4f24a7789532dcd65d10ce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:39:10Z,use_quota=True,user_id='093bfc5555254ebe9ed67673234bffbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:39:10 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-59d28be3-c691-4641-b702-0681579d894e tempest-VolumesListAdminTestJSON-1583005234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaba94e9-5210-4a0c-acba-0c6057833427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:39:10 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-59d28be3-c691-4641-b702-0681579d894e tempest-VolumesListAdminTestJSON-1583005234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaba94e9-5210-4a0c-acba-0c6057833427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:39:10 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-59d28be3-c691-4641-b702-0681579d894e tempest-VolumesListAdminTestJSON-1583005234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e357ec-c14a-40f8-bffd-f472f3186f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:39:10 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-59d28be3-c691-4641-b702-0681579d894e tempest-VolumesListAdminTestJSON-1583005234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e357ec-c14a-40f8-bffd-f472f3186f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1cec6c4-cf26-49fd-8c21-78100db0c199', 'volume_name': 'volume-d1cec6c4-cf26-49fd-8c21-78100db0c199', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:39:10 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-59d28be3-c691-4641-b702-0681579d894e tempest-VolumesListAdminTestJSON-1583005234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9568e453-618d-45f8-8e38-d96ff3f75bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:39:10 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-59d28be3-c691-4641-b702-0681579d894e tempest-VolumesListAdminTestJSON-1583005234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9568e453-618d-45f8-8e38-d96ff3f75bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:39:10 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-59d28be3-c691-4641-b702-0681579d894e tempest-VolumesListAdminTestJSON-1583005234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6ffbb80-9c6b-4627-b139-f91799c1d54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:39:10 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-59d28be3-c691-4641-b702-0681579d894e tempest-VolumesListAdminTestJSON-1583005234 None] Volume d1cec6c4-cf26-49fd-8c21-78100db0c199: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1cec6c4-cf26-49fd-8c21-78100db0c199', 'volume_size': 1}
Sep 18 11:39:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-59d28be3-c691-4641-b702-0681579d894e tempest-VolumesListAdminTestJSON-1583005234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:39:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-59d28be3-c691-4641-b702-0681579d894e tempest-VolumesListAdminTestJSON-1583005234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:39:10 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-59d28be3-c691-4641-b702-0681579d894e tempest-VolumesListAdminTestJSON-1583005234 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1032087950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1cec6c4-cf26-49fd-8c21-78100db0c199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='911ef021a4f24a7789532dcd65d10ce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:39:10Z,use_quota=True,user_id='093bfc5555254ebe9ed67673234bffbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:39:10 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-59d28be3-c691-4641-b702-0681579d894e tempest-VolumesListAdminTestJSON-1583005234 None] Creating volume d1cec6c4-cf26-49fd-8c21-78100db0c199 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:39:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-59d28be3-c691-4641-b702-0681579d894e tempest-VolumesListAdminTestJSON-1583005234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:39:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-59d28be3-c691-4641-b702-0681579d894e tempest-VolumesListAdminTestJSON-1583005234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:39:10 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-59d28be3-c691-4641-b702-0681579d894e tempest-VolumesListAdminTestJSON-1583005234 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:39:10 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-59d28be3-c691-4641-b702-0681579d894e tempest-VolumesListAdminTestJSON-1583005234 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:39:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-59d28be3-c691-4641-b702-0681579d894e tempest-VolumesListAdminTestJSON-1583005234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:39:10 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-59d28be3-c691-4641-b702-0681579d894e tempest-VolumesListAdminTestJSON-1583005234 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:39:10 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-59d28be3-c691-4641-b702-0681579d894e tempest-VolumesListAdminTestJSON-1583005234 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:39:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-59d28be3-c691-4641-b702-0681579d894e tempest-VolumesListAdminTestJSON-1583005234 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d1cec6c4-cf26-49fd-8c21-78100db0c199 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:39:10 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=25, name=volume-d1cec6c4-cf26-49fd-8c21-78100db0c199, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:39:11 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-59d28be3-c691-4641-b702-0681579d894e tempest-VolumesListAdminTestJSON-1583005234 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d1cec6c4-cf26-49fd-8c21-78100db0c199 1073741824" returned: 0 in 0.866s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:39:11 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-59d28be3-c691-4641-b702-0681579d894e tempest-VolumesListAdminTestJSON-1583005234 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d1cec6c4-cf26-49fd-8c21-78100db0c199 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:39:11 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-59d28be3-c691-4641-b702-0681579d894e tempest-VolumesListAdminTestJSON-1583005234 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d1cec6c4-cf26-49fd-8c21-78100db0c199" returned: 0 in 0.157s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:39:11 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-59d28be3-c691-4641-b702-0681579d894e tempest-VolumesListAdminTestJSON-1583005234 None] <== create_volume: return (1129ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:39:11 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-59d28be3-c691-4641-b702-0681579d894e tempest-VolumesListAdminTestJSON-1583005234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:39:11 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-59d28be3-c691-4641-b702-0681579d894e tempest-VolumesListAdminTestJSON-1583005234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6ffbb80-9c6b-4627-b139-f91799c1d54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1cec6c4-cf26-49fd-8c21-78100db0c199', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:39:12 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-59d28be3-c691-4641-b702-0681579d894e tempest-VolumesListAdminTestJSON-1583005234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c944983-d455-4933-b9f8-cfd79afd7175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:39:12 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-59d28be3-c691-4641-b702-0681579d894e tempest-VolumesListAdminTestJSON-1583005234 None] Volume volume-d1cec6c4-cf26-49fd-8c21-78100db0c199 (d1cec6c4-cf26-49fd-8c21-78100db0c199): created successfully
Sep 18 11:39:12 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-59d28be3-c691-4641-b702-0681579d894e tempest-VolumesListAdminTestJSON-1583005234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c944983-d455-4933-b9f8-cfd79afd7175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:39:12 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-59d28be3-c691-4641-b702-0681579d894e tempest-VolumesListAdminTestJSON-1583005234 None] Flow 'volume_create_manager' (1b755dcf-b08a-4a90-85b9-b78af8f1ea8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:39:12 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-59d28be3-c691-4641-b702-0681579d894e tempest-VolumesListAdminTestJSON-1583005234 None] Created volume successfully.
Sep 18 11:39:13 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 11:39:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:39:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:39:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:39:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:39:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.066s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:39:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:39:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.522s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:39:14 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:39:18 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-d3743573-dd92-4ae4-9980-bf015b561840 tempest-VolumesListAdminTestJSON-1583005234 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:39:19 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3743573-dd92-4ae4-9980-bf015b561840 tempest-VolumesListAdminTestJSON-1583005234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:39:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d3743573-dd92-4ae4-9980-bf015b561840 tempest-VolumesListAdminTestJSON-1583005234 None] Flow 'volume_create_manager' (29f6319d-24fc-4f39-a297-f1844c1d9559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:39:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d3743573-dd92-4ae4-9980-bf015b561840 tempest-VolumesListAdminTestJSON-1583005234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (415179aa-d564-4a9c-8492-919a155da0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:39:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d3743573-dd92-4ae4-9980-bf015b561840 tempest-VolumesListAdminTestJSON-1583005234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (415179aa-d564-4a9c-8492-919a155da0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-995358137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59e0f4b8-640b-4dfd-a5c3-46d6b4e97a16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='911ef021a4f24a7789532dcd65d10ce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:39:16Z,use_quota=True,user_id='093bfc5555254ebe9ed67673234bffbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:39:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d3743573-dd92-4ae4-9980-bf015b561840 tempest-VolumesListAdminTestJSON-1583005234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4f55f8c-e6c5-4fda-bb53-dd09462b4ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:39:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d3743573-dd92-4ae4-9980-bf015b561840 tempest-VolumesListAdminTestJSON-1583005234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4f55f8c-e6c5-4fda-bb53-dd09462b4ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:39:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d3743573-dd92-4ae4-9980-bf015b561840 tempest-VolumesListAdminTestJSON-1583005234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf967c55-002a-4939-981b-1947e384d8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:39:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d3743573-dd92-4ae4-9980-bf015b561840 tempest-VolumesListAdminTestJSON-1583005234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf967c55-002a-4939-981b-1947e384d8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59e0f4b8-640b-4dfd-a5c3-46d6b4e97a16', 'volume_name': 'volume-59e0f4b8-640b-4dfd-a5c3-46d6b4e97a16', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:39:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d3743573-dd92-4ae4-9980-bf015b561840 tempest-VolumesListAdminTestJSON-1583005234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5925bd00-626e-43c8-808c-88102e076b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:39:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d3743573-dd92-4ae4-9980-bf015b561840 tempest-VolumesListAdminTestJSON-1583005234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5925bd00-626e-43c8-808c-88102e076b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:39:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d3743573-dd92-4ae4-9980-bf015b561840 tempest-VolumesListAdminTestJSON-1583005234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c695ce9a-ec37-4a73-8175-9b11ea02d01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:39:20 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-d3743573-dd92-4ae4-9980-bf015b561840 tempest-VolumesListAdminTestJSON-1583005234 None] Volume 59e0f4b8-640b-4dfd-a5c3-46d6b4e97a16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59e0f4b8-640b-4dfd-a5c3-46d6b4e97a16', 'volume_size': 1}
Sep 18 11:39:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d3743573-dd92-4ae4-9980-bf015b561840 tempest-VolumesListAdminTestJSON-1583005234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:39:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d3743573-dd92-4ae4-9980-bf015b561840 tempest-VolumesListAdminTestJSON-1583005234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.024s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:39:20 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-d3743573-dd92-4ae4-9980-bf015b561840 tempest-VolumesListAdminTestJSON-1583005234 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-995358137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59e0f4b8-640b-4dfd-a5c3-46d6b4e97a16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='911ef021a4f24a7789532dcd65d10ce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:39:16Z,use_quota=True,user_id='093bfc5555254ebe9ed67673234bffbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:39:20 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-d3743573-dd92-4ae4-9980-bf015b561840 tempest-VolumesListAdminTestJSON-1583005234 None] Creating volume 59e0f4b8-640b-4dfd-a5c3-46d6b4e97a16 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:39:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d3743573-dd92-4ae4-9980-bf015b561840 tempest-VolumesListAdminTestJSON-1583005234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:39:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d3743573-dd92-4ae4-9980-bf015b561840 tempest-VolumesListAdminTestJSON-1583005234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:39:20 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-d3743573-dd92-4ae4-9980-bf015b561840 tempest-VolumesListAdminTestJSON-1583005234 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:39:20 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-d3743573-dd92-4ae4-9980-bf015b561840 tempest-VolumesListAdminTestJSON-1583005234 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:39:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d3743573-dd92-4ae4-9980-bf015b561840 tempest-VolumesListAdminTestJSON-1583005234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.147s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:39:21 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-d3743573-dd92-4ae4-9980-bf015b561840 tempest-VolumesListAdminTestJSON-1583005234 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:39:21 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-d3743573-dd92-4ae4-9980-bf015b561840 tempest-VolumesListAdminTestJSON-1583005234 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:39:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d3743573-dd92-4ae4-9980-bf015b561840 tempest-VolumesListAdminTestJSON-1583005234 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-59e0f4b8-640b-4dfd-a5c3-46d6b4e97a16 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:39:21 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=26, name=volume-59e0f4b8-640b-4dfd-a5c3-46d6b4e97a16, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:39:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d3743573-dd92-4ae4-9980-bf015b561840 tempest-VolumesListAdminTestJSON-1583005234 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-59e0f4b8-640b-4dfd-a5c3-46d6b4e97a16 1073741824" returned: 0 in 1.988s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:39:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d3743573-dd92-4ae4-9980-bf015b561840 tempest-VolumesListAdminTestJSON-1583005234 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-59e0f4b8-640b-4dfd-a5c3-46d6b4e97a16 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:39:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d3743573-dd92-4ae4-9980-bf015b561840 tempest-VolumesListAdminTestJSON-1583005234 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-59e0f4b8-640b-4dfd-a5c3-46d6b4e97a16" returned: 0 in 0.906s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:39:24 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-d3743573-dd92-4ae4-9980-bf015b561840 tempest-VolumesListAdminTestJSON-1583005234 None] <== create_volume: return (3446ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:39:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d3743573-dd92-4ae4-9980-bf015b561840 tempest-VolumesListAdminTestJSON-1583005234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.562s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:39:24 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d3743573-dd92-4ae4-9980-bf015b561840 tempest-VolumesListAdminTestJSON-1583005234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c695ce9a-ec37-4a73-8175-9b11ea02d01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59e0f4b8-640b-4dfd-a5c3-46d6b4e97a16', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:39:24 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d3743573-dd92-4ae4-9980-bf015b561840 tempest-VolumesListAdminTestJSON-1583005234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0dc3f8d-9720-4f45-a999-8534a620572f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:39:25 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-d3743573-dd92-4ae4-9980-bf015b561840 tempest-VolumesListAdminTestJSON-1583005234 None] Volume volume-59e0f4b8-640b-4dfd-a5c3-46d6b4e97a16 (59e0f4b8-640b-4dfd-a5c3-46d6b4e97a16): created successfully
Sep 18 11:39:25 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d3743573-dd92-4ae4-9980-bf015b561840 tempest-VolumesListAdminTestJSON-1583005234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0dc3f8d-9720-4f45-a999-8534a620572f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:39:25 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d3743573-dd92-4ae4-9980-bf015b561840 tempest-VolumesListAdminTestJSON-1583005234 None] Flow 'volume_create_manager' (29f6319d-24fc-4f39-a297-f1844c1d9559) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:39:25 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-d3743573-dd92-4ae4-9980-bf015b561840 tempest-VolumesListAdminTestJSON-1583005234 None] Created volume successfully.
Sep 18 11:39:27 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-eae6f161-3ab1-4244-963f-abad8f9ec022 tempest-VolumesListAdminTestJSON-260510249 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:39:27 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-eae6f161-3ab1-4244-963f-abad8f9ec022 tempest-VolumesListAdminTestJSON-260510249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:39:27 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-eae6f161-3ab1-4244-963f-abad8f9ec022 tempest-VolumesListAdminTestJSON-260510249 None] Flow 'volume_create_manager' (3d1f9580-0f3f-4fc0-92da-1584e6fc0e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:39:27 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-eae6f161-3ab1-4244-963f-abad8f9ec022 tempest-VolumesListAdminTestJSON-260510249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dbf311d-c890-4db5-afbb-9f6221eeaf1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:39:28 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-eae6f161-3ab1-4244-963f-abad8f9ec022 tempest-VolumesListAdminTestJSON-260510249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dbf311d-c890-4db5-afbb-9f6221eeaf1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06d453ad-8663-42f0-8954-6546b8ca3abd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e134271e95df4ed49f3cb1e01001f8b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:39:27Z,use_quota=True,user_id='64bd9edfb2a344a9a397a20e07cb4735',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:39:28 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-eae6f161-3ab1-4244-963f-abad8f9ec022 tempest-VolumesListAdminTestJSON-260510249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7fa6e0c-1f96-4c6a-833c-4a8e7917de66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:39:28 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-eae6f161-3ab1-4244-963f-abad8f9ec022 tempest-VolumesListAdminTestJSON-260510249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7fa6e0c-1f96-4c6a-833c-4a8e7917de66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:39:28 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-eae6f161-3ab1-4244-963f-abad8f9ec022 tempest-VolumesListAdminTestJSON-260510249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (764f1e07-4d6e-4275-8cce-6954ea5e5acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:39:28 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-eae6f161-3ab1-4244-963f-abad8f9ec022 tempest-VolumesListAdminTestJSON-260510249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (764f1e07-4d6e-4275-8cce-6954ea5e5acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06d453ad-8663-42f0-8954-6546b8ca3abd', 'volume_name': 'volume-06d453ad-8663-42f0-8954-6546b8ca3abd', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:39:28 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-eae6f161-3ab1-4244-963f-abad8f9ec022 tempest-VolumesListAdminTestJSON-260510249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (388b4e50-611c-4475-87fb-d2bf4c8ccf04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:39:28 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-eae6f161-3ab1-4244-963f-abad8f9ec022 tempest-VolumesListAdminTestJSON-260510249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (388b4e50-611c-4475-87fb-d2bf4c8ccf04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:39:28 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-eae6f161-3ab1-4244-963f-abad8f9ec022 tempest-VolumesListAdminTestJSON-260510249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad225f29-dd49-46a1-93a4-7bb35ba9931e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:39:28 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-eae6f161-3ab1-4244-963f-abad8f9ec022 tempest-VolumesListAdminTestJSON-260510249 None] Volume 06d453ad-8663-42f0-8954-6546b8ca3abd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06d453ad-8663-42f0-8954-6546b8ca3abd', 'volume_size': 1}
Sep 18 11:39:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-eae6f161-3ab1-4244-963f-abad8f9ec022 tempest-VolumesListAdminTestJSON-260510249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:39:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-eae6f161-3ab1-4244-963f-abad8f9ec022 tempest-VolumesListAdminTestJSON-260510249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.057s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:39:28 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-eae6f161-3ab1-4244-963f-abad8f9ec022 tempest-VolumesListAdminTestJSON-260510249 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06d453ad-8663-42f0-8954-6546b8ca3abd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e134271e95df4ed49f3cb1e01001f8b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:39:27Z,use_quota=True,user_id='64bd9edfb2a344a9a397a20e07cb4735',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:39:28 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-eae6f161-3ab1-4244-963f-abad8f9ec022 tempest-VolumesListAdminTestJSON-260510249 None] Creating volume 06d453ad-8663-42f0-8954-6546b8ca3abd {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:39:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-eae6f161-3ab1-4244-963f-abad8f9ec022 tempest-VolumesListAdminTestJSON-260510249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:39:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-eae6f161-3ab1-4244-963f-abad8f9ec022 tempest-VolumesListAdminTestJSON-260510249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:39:28 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-eae6f161-3ab1-4244-963f-abad8f9ec022 tempest-VolumesListAdminTestJSON-260510249 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:39:28 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-eae6f161-3ab1-4244-963f-abad8f9ec022 tempest-VolumesListAdminTestJSON-260510249 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:39:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-eae6f161-3ab1-4244-963f-abad8f9ec022 tempest-VolumesListAdminTestJSON-260510249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:39:28 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-eae6f161-3ab1-4244-963f-abad8f9ec022 tempest-VolumesListAdminTestJSON-260510249 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:39:28 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-eae6f161-3ab1-4244-963f-abad8f9ec022 tempest-VolumesListAdminTestJSON-260510249 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:39:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-eae6f161-3ab1-4244-963f-abad8f9ec022 tempest-VolumesListAdminTestJSON-260510249 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-06d453ad-8663-42f0-8954-6546b8ca3abd 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:39:28 devstack quobyte-client[83193]: System call of process 90382 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:39:28 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=27, name=volume-06d453ad-8663-42f0-8954-6546b8ca3abd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:39:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-eae6f161-3ab1-4244-963f-abad8f9ec022 tempest-VolumesListAdminTestJSON-260510249 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-06d453ad-8663-42f0-8954-6546b8ca3abd 1073741824" returned: 0 in 1.407s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:39:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-eae6f161-3ab1-4244-963f-abad8f9ec022 tempest-VolumesListAdminTestJSON-260510249 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-06d453ad-8663-42f0-8954-6546b8ca3abd {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:39:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-eae6f161-3ab1-4244-963f-abad8f9ec022 tempest-VolumesListAdminTestJSON-260510249 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-06d453ad-8663-42f0-8954-6546b8ca3abd" returned: 0 in 0.350s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:39:30 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-eae6f161-3ab1-4244-963f-abad8f9ec022 tempest-VolumesListAdminTestJSON-260510249 None] <== create_volume: return (1967ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:39:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-eae6f161-3ab1-4244-963f-abad8f9ec022 tempest-VolumesListAdminTestJSON-260510249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:39:30 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-eae6f161-3ab1-4244-963f-abad8f9ec022 tempest-VolumesListAdminTestJSON-260510249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad225f29-dd49-46a1-93a4-7bb35ba9931e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06d453ad-8663-42f0-8954-6546b8ca3abd', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:39:30 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-eae6f161-3ab1-4244-963f-abad8f9ec022 tempest-VolumesListAdminTestJSON-260510249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e88dc76a-cb28-473d-8926-7fb47f7fb728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:39:30 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-eae6f161-3ab1-4244-963f-abad8f9ec022 tempest-VolumesListAdminTestJSON-260510249 None] Volume volume-06d453ad-8663-42f0-8954-6546b8ca3abd (06d453ad-8663-42f0-8954-6546b8ca3abd): created successfully
Sep 18 11:39:31 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-eae6f161-3ab1-4244-963f-abad8f9ec022 tempest-VolumesListAdminTestJSON-260510249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e88dc76a-cb28-473d-8926-7fb47f7fb728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:39:31 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-eae6f161-3ab1-4244-963f-abad8f9ec022 tempest-VolumesListAdminTestJSON-260510249 None] Flow 'volume_create_manager' (3d1f9580-0f3f-4fc0-92da-1584e6fc0e9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:39:31 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-eae6f161-3ab1-4244-963f-abad8f9ec022 tempest-VolumesListAdminTestJSON-260510249 None] Created volume successfully.
Sep 18 11:39:33 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f9f56130-eb40-49ba-986e-5bfd3026a56b tempest-VolumesListAdminTestJSON-260510249 None] Acquiring lock "cinder-06d453ad-8663-42f0-8954-6546b8ca3abd-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:39:33 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f9f56130-eb40-49ba-986e-5bfd3026a56b tempest-VolumesListAdminTestJSON-260510249 None] Lock "cinder-06d453ad-8663-42f0-8954-6546b8ca3abd-delete_volume" acquired by "delete_volume" :: waited 0.292s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:39:34 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-a8e6773f-99e6-4f19-9e50-04c9cd984469 tempest-VolumesListAdminTestJSON-1583005234 None] Acquiring lock "cinder-59e0f4b8-640b-4dfd-a5c3-46d6b4e97a16-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:39:34 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-f9f56130-eb40-49ba-986e-5bfd3026a56b tempest-VolumesListAdminTestJSON-260510249 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:39:34 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f9f56130-eb40-49ba-986e-5bfd3026a56b tempest-VolumesListAdminTestJSON-260510249 None] Acquiring lock "cinder-quobyte-06d453ad-8663-42f0-8954-6546b8ca3abd" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:39:34 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-a8e6773f-99e6-4f19-9e50-04c9cd984469 tempest-VolumesListAdminTestJSON-1583005234 None] Lock "cinder-59e0f4b8-640b-4dfd-a5c3-46d6b4e97a16-delete_volume" acquired by "delete_volume" :: waited 0.140s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:39:34 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f9f56130-eb40-49ba-986e-5bfd3026a56b tempest-VolumesListAdminTestJSON-260510249 None] Lock "cinder-quobyte-06d453ad-8663-42f0-8954-6546b8ca3abd" acquired by "delete_volume" :: waited 0.241s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:39:34 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[186d9e82-119f-4f31-8bae-220a17bdcc2f]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:39:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f9f56130-eb40-49ba-986e-5bfd3026a56b tempest-VolumesListAdminTestJSON-260510249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-06d453ad-8663-42f0-8954-6546b8ca3abd {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:39:37 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-a8e6773f-99e6-4f19-9e50-04c9cd984469 tempest-VolumesListAdminTestJSON-1583005234 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:39:37 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-a8e6773f-99e6-4f19-9e50-04c9cd984469 tempest-VolumesListAdminTestJSON-1583005234 None] Acquiring lock "cinder-quobyte-59e0f4b8-640b-4dfd-a5c3-46d6b4e97a16" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:39:37 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-a8e6773f-99e6-4f19-9e50-04c9cd984469 tempest-VolumesListAdminTestJSON-1583005234 None] Lock "cinder-quobyte-59e0f4b8-640b-4dfd-a5c3-46d6b4e97a16" acquired by "delete_volume" :: waited 0.351s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:39:37 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6506f10b-a183-422a-9edf-5f91c8e94ee0]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:39:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a8e6773f-99e6-4f19-9e50-04c9cd984469 tempest-VolumesListAdminTestJSON-1583005234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-59e0f4b8-640b-4dfd-a5c3-46d6b4e97a16 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:39:37 devstack quobyte-client[83193]: System call of process 90444 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:39:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f9f56130-eb40-49ba-986e-5bfd3026a56b tempest-VolumesListAdminTestJSON-260510249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-06d453ad-8663-42f0-8954-6546b8ca3abd" returned: 0 in 3.154s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:39:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f9f56130-eb40-49ba-986e-5bfd3026a56b tempest-VolumesListAdminTestJSON-260510249 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-06d453ad-8663-42f0-8954-6546b8ca3abd {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:39:39 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f9f56130-eb40-49ba-986e-5bfd3026a56b tempest-VolumesListAdminTestJSON-260510249 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-06d453ad-8663-42f0-8954-6546b8ca3abd" returned: 0 in 0.579s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:39:39 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f9f56130-eb40-49ba-986e-5bfd3026a56b tempest-VolumesListAdminTestJSON-260510249 None] Lock "cinder-quobyte-06d453ad-8663-42f0-8954-6546b8ca3abd" released by "delete_volume" :: held 4.997s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:39:40 devstack quobyte-client[83193]: System call of process 90459 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:39:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a8e6773f-99e6-4f19-9e50-04c9cd984469 tempest-VolumesListAdminTestJSON-1583005234 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-59e0f4b8-640b-4dfd-a5c3-46d6b4e97a16" returned: 0 in 2.800s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:39:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a8e6773f-99e6-4f19-9e50-04c9cd984469 tempest-VolumesListAdminTestJSON-1583005234 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-59e0f4b8-640b-4dfd-a5c3-46d6b4e97a16 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:39:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a8e6773f-99e6-4f19-9e50-04c9cd984469 tempest-VolumesListAdminTestJSON-1583005234 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-59e0f4b8-640b-4dfd-a5c3-46d6b4e97a16" returned: 0 in 1.411s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:39:41 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-f9f56130-eb40-49ba-986e-5bfd3026a56b tempest-VolumesListAdminTestJSON-260510249 None] Created reservations ['316082c6-6ae8-4dde-bcd3-f3ae2f23b84e', '18bc21f8-4a88-4c96-977d-abf75d9bc740', '9374b761-adc3-4c49-b58f-f5f5f0e223a0', '88e147b6-bca2-433c-a98d-afe99d1f26ca'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:39:42 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-a8e6773f-99e6-4f19-9e50-04c9cd984469 tempest-VolumesListAdminTestJSON-1583005234 None] Lock "cinder-quobyte-59e0f4b8-640b-4dfd-a5c3-46d6b4e97a16" released by "delete_volume" :: held 4.783s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:39:42 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f9f56130-eb40-49ba-986e-5bfd3026a56b tempest-VolumesListAdminTestJSON-260510249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:39:42 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f9f56130-eb40-49ba-986e-5bfd3026a56b tempest-VolumesListAdminTestJSON-260510249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.026s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:39:42 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f9f56130-eb40-49ba-986e-5bfd3026a56b tempest-VolumesListAdminTestJSON-260510249 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:39:42 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f9f56130-eb40-49ba-986e-5bfd3026a56b tempest-VolumesListAdminTestJSON-260510249 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:39:42 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f9f56130-eb40-49ba-986e-5bfd3026a56b tempest-VolumesListAdminTestJSON-260510249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.099s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:39:42 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f9f56130-eb40-49ba-986e-5bfd3026a56b tempest-VolumesListAdminTestJSON-260510249 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:39:43 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-a8e6773f-99e6-4f19-9e50-04c9cd984469 tempest-VolumesListAdminTestJSON-1583005234 None] Created reservations ['94650035-1fd8-4c35-b121-c9c646973240', '13de536f-df7b-47f5-98c7-6128a8b924d7', '0713b5c4-cabc-42bd-b7d2-cab383789ecd', '3fc0c41d-dd27-4554-971a-a059682a8f99'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:39:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f9f56130-eb40-49ba-986e-5bfd3026a56b tempest-VolumesListAdminTestJSON-260510249 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 1.212s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:39:44 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-f9f56130-eb40-49ba-986e-5bfd3026a56b tempest-VolumesListAdminTestJSON-260510249 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:39:44 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-f9f56130-eb40-49ba-986e-5bfd3026a56b tempest-VolumesListAdminTestJSON-260510249 None] Deleted volume successfully.
Sep 18 11:39:44 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f9f56130-eb40-49ba-986e-5bfd3026a56b tempest-VolumesListAdminTestJSON-260510249 None] Lock "cinder-06d453ad-8663-42f0-8954-6546b8ca3abd-delete_volume" released by "delete_volume" :: held 10.756s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:39:45 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a8e6773f-99e6-4f19-9e50-04c9cd984469 tempest-VolumesListAdminTestJSON-1583005234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:39:45 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a8e6773f-99e6-4f19-9e50-04c9cd984469 tempest-VolumesListAdminTestJSON-1583005234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:39:45 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a8e6773f-99e6-4f19-9e50-04c9cd984469 tempest-VolumesListAdminTestJSON-1583005234 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:39:45 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a8e6773f-99e6-4f19-9e50-04c9cd984469 tempest-VolumesListAdminTestJSON-1583005234 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:39:45 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a8e6773f-99e6-4f19-9e50-04c9cd984469 tempest-VolumesListAdminTestJSON-1583005234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.098s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:39:45 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a8e6773f-99e6-4f19-9e50-04c9cd984469 tempest-VolumesListAdminTestJSON-1583005234 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:39:46 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a8e6773f-99e6-4f19-9e50-04c9cd984469 tempest-VolumesListAdminTestJSON-1583005234 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.862s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:39:46 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a8e6773f-99e6-4f19-9e50-04c9cd984469 tempest-VolumesListAdminTestJSON-1583005234 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:39:46 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-cb919bd1-2365-42d7-8cea-c799790d0b3e tempest-VolumesListAdminTestJSON-1583005234 None] Acquiring lock "cinder-d1cec6c4-cf26-49fd-8c21-78100db0c199-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:39:46 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-a8e6773f-99e6-4f19-9e50-04c9cd984469 tempest-VolumesListAdminTestJSON-1583005234 None] Deleted volume successfully.
Sep 18 11:39:47 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-cb919bd1-2365-42d7-8cea-c799790d0b3e tempest-VolumesListAdminTestJSON-1583005234 None] Lock "cinder-d1cec6c4-cf26-49fd-8c21-78100db0c199-delete_volume" acquired by "delete_volume" :: waited 0.989s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:39:47 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-a8e6773f-99e6-4f19-9e50-04c9cd984469 tempest-VolumesListAdminTestJSON-1583005234 None] Lock "cinder-59e0f4b8-640b-4dfd-a5c3-46d6b4e97a16-delete_volume" released by "delete_volume" :: held 13.351s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:39:48 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-cb919bd1-2365-42d7-8cea-c799790d0b3e tempest-VolumesListAdminTestJSON-1583005234 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:39:48 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-cb919bd1-2365-42d7-8cea-c799790d0b3e tempest-VolumesListAdminTestJSON-1583005234 None] Acquiring lock "cinder-quobyte-d1cec6c4-cf26-49fd-8c21-78100db0c199" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:39:48 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-cb919bd1-2365-42d7-8cea-c799790d0b3e tempest-VolumesListAdminTestJSON-1583005234 None] Lock "cinder-quobyte-d1cec6c4-cf26-49fd-8c21-78100db0c199" acquired by "delete_volume" :: waited 0.032s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:39:48 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ee1e56-20a2-4f04-979f-83c3ff3a64b6]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:39:48 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-cb919bd1-2365-42d7-8cea-c799790d0b3e tempest-VolumesListAdminTestJSON-1583005234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d1cec6c4-cf26-49fd-8c21-78100db0c199 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:39:49 devstack quobyte-client[83193]: System call of process 90481 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:39:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-cb919bd1-2365-42d7-8cea-c799790d0b3e tempest-VolumesListAdminTestJSON-1583005234 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d1cec6c4-cf26-49fd-8c21-78100db0c199" returned: 0 in 1.490s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:39:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-cb919bd1-2365-42d7-8cea-c799790d0b3e tempest-VolumesListAdminTestJSON-1583005234 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d1cec6c4-cf26-49fd-8c21-78100db0c199 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:39:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-cb919bd1-2365-42d7-8cea-c799790d0b3e tempest-VolumesListAdminTestJSON-1583005234 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d1cec6c4-cf26-49fd-8c21-78100db0c199" returned: 0 in 0.476s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:39:50 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-cb919bd1-2365-42d7-8cea-c799790d0b3e tempest-VolumesListAdminTestJSON-1583005234 None] Lock "cinder-quobyte-d1cec6c4-cf26-49fd-8c21-78100db0c199" released by "delete_volume" :: held 2.629s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:39:51 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-cb919bd1-2365-42d7-8cea-c799790d0b3e tempest-VolumesListAdminTestJSON-1583005234 None] Created reservations ['64277e50-89c3-4396-aa2f-fc95bf8a5b82', '55f3091e-eca6-4b69-90d0-31b0f689904f', 'ba8a911f-60f1-416d-8575-538821fb87fe', '9f3c02e7-40c8-474c-9f2c-d31be2e80be3'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:39:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-cb919bd1-2365-42d7-8cea-c799790d0b3e tempest-VolumesListAdminTestJSON-1583005234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:39:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-cb919bd1-2365-42d7-8cea-c799790d0b3e tempest-VolumesListAdminTestJSON-1583005234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:39:52 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-cb919bd1-2365-42d7-8cea-c799790d0b3e tempest-VolumesListAdminTestJSON-1583005234 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:39:52 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-cb919bd1-2365-42d7-8cea-c799790d0b3e tempest-VolumesListAdminTestJSON-1583005234 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:39:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-cb919bd1-2365-42d7-8cea-c799790d0b3e tempest-VolumesListAdminTestJSON-1583005234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:39:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-cb919bd1-2365-42d7-8cea-c799790d0b3e tempest-VolumesListAdminTestJSON-1583005234 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:39:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-cb919bd1-2365-42d7-8cea-c799790d0b3e tempest-VolumesListAdminTestJSON-1583005234 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.234s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:39:52 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-cb919bd1-2365-42d7-8cea-c799790d0b3e tempest-VolumesListAdminTestJSON-1583005234 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:39:52 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-cb919bd1-2365-42d7-8cea-c799790d0b3e tempest-VolumesListAdminTestJSON-1583005234 None] Deleted volume successfully.
Sep 18 11:39:53 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-cb919bd1-2365-42d7-8cea-c799790d0b3e tempest-VolumesListAdminTestJSON-1583005234 None] Lock "cinder-d1cec6c4-cf26-49fd-8c21-78100db0c199-delete_volume" released by "delete_volume" :: held 5.431s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:39:53 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0985aae9-3d50-4ffa-9dcd-da4d40def5e5 tempest-VolumesListAdminTestJSON-1583005234 None] Acquiring lock "cinder-27cb56eb-3f59-4c6e-8a61-97de7e6035c1-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:39:53 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0985aae9-3d50-4ffa-9dcd-da4d40def5e5 tempest-VolumesListAdminTestJSON-1583005234 None] Lock "cinder-27cb56eb-3f59-4c6e-8a61-97de7e6035c1-delete_volume" acquired by "delete_volume" :: waited 0.133s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:39:54 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-0985aae9-3d50-4ffa-9dcd-da4d40def5e5 tempest-VolumesListAdminTestJSON-1583005234 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:39:54 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0985aae9-3d50-4ffa-9dcd-da4d40def5e5 tempest-VolumesListAdminTestJSON-1583005234 None] Acquiring lock "cinder-quobyte-27cb56eb-3f59-4c6e-8a61-97de7e6035c1" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:39:54 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0985aae9-3d50-4ffa-9dcd-da4d40def5e5 tempest-VolumesListAdminTestJSON-1583005234 None] Lock "cinder-quobyte-27cb56eb-3f59-4c6e-8a61-97de7e6035c1" acquired by "delete_volume" :: waited 0.249s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:39:54 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[803726c7-c7fb-431a-bf51-1f633c480b8a]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:39:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0985aae9-3d50-4ffa-9dcd-da4d40def5e5 tempest-VolumesListAdminTestJSON-1583005234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-27cb56eb-3f59-4c6e-8a61-97de7e6035c1 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:39:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0985aae9-3d50-4ffa-9dcd-da4d40def5e5 tempest-VolumesListAdminTestJSON-1583005234 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-27cb56eb-3f59-4c6e-8a61-97de7e6035c1" returned: 0 in 2.714s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:39:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0985aae9-3d50-4ffa-9dcd-da4d40def5e5 tempest-VolumesListAdminTestJSON-1583005234 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-27cb56eb-3f59-4c6e-8a61-97de7e6035c1 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:39:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0985aae9-3d50-4ffa-9dcd-da4d40def5e5 tempest-VolumesListAdminTestJSON-1583005234 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-27cb56eb-3f59-4c6e-8a61-97de7e6035c1" returned: 0 in 0.346s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:39:58 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0985aae9-3d50-4ffa-9dcd-da4d40def5e5 tempest-VolumesListAdminTestJSON-1583005234 None] Lock "cinder-quobyte-27cb56eb-3f59-4c6e-8a61-97de7e6035c1" released by "delete_volume" :: held 3.954s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:39:58 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:UPDATE=27,cinder:SELECT=24,cinder:DELETE=3,cinder:INSERT=7 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:39:59 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=18,cinder:UPDATE=38,cinder:DELETE=4,cinder:INSERT=5 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:39:59 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-0985aae9-3d50-4ffa-9dcd-da4d40def5e5 tempest-VolumesListAdminTestJSON-1583005234 None] Created reservations ['18c89f54-9023-49c2-aa1e-5ebb5b3007e6', '44516861-fca6-4da6-9fa6-b81612ec9718', 'a1feb5b2-f08c-40ac-b43c-7dd55f24478b', '733e8ffc-5ba7-402e-820b-34b0b508fed4'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:40:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0985aae9-3d50-4ffa-9dcd-da4d40def5e5 tempest-VolumesListAdminTestJSON-1583005234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:40:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0985aae9-3d50-4ffa-9dcd-da4d40def5e5 tempest-VolumesListAdminTestJSON-1583005234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.036s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:40:00 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-0985aae9-3d50-4ffa-9dcd-da4d40def5e5 tempest-VolumesListAdminTestJSON-1583005234 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:40:00 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-0985aae9-3d50-4ffa-9dcd-da4d40def5e5 tempest-VolumesListAdminTestJSON-1583005234 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:40:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0985aae9-3d50-4ffa-9dcd-da4d40def5e5 tempest-VolumesListAdminTestJSON-1583005234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:40:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0985aae9-3d50-4ffa-9dcd-da4d40def5e5 tempest-VolumesListAdminTestJSON-1583005234 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:40:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0985aae9-3d50-4ffa-9dcd-da4d40def5e5 tempest-VolumesListAdminTestJSON-1583005234 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.464s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:40:01 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-0985aae9-3d50-4ffa-9dcd-da4d40def5e5 tempest-VolumesListAdminTestJSON-1583005234 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:40:01 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-0985aae9-3d50-4ffa-9dcd-da4d40def5e5 tempest-VolumesListAdminTestJSON-1583005234 None] Deleted volume successfully.
Sep 18 11:40:02 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0985aae9-3d50-4ffa-9dcd-da4d40def5e5 tempest-VolumesListAdminTestJSON-1583005234 None] Lock "cinder-27cb56eb-3f59-4c6e-8a61-97de7e6035c1-delete_volume" released by "delete_volume" :: held 8.997s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:40:10 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=6,cinder:INSERT=4,cinder:UPDATE=14 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:40:12 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:UPDATE=1,cinder:DELETE=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:40:13 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 11:40:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:40:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:40:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:40:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:40:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:40:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:40:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.386s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:40:14 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:40:14 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-37953a61-d94f-4ffa-9614-273989fd5f88 tempest-ServersNegativeTestJSON-1761324635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:40:14 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-37953a61-d94f-4ffa-9614-273989fd5f88 tempest-ServersNegativeTestJSON-1761324635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:40:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-37953a61-d94f-4ffa-9614-273989fd5f88 tempest-ServersNegativeTestJSON-1761324635 None] Flow 'volume_create_manager' (846b161d-07e6-4b12-9a4d-5430adc5d14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:40:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-37953a61-d94f-4ffa-9614-273989fd5f88 tempest-ServersNegativeTestJSON-1761324635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c659232-d83d-4191-975d-dad193673bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:40:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-37953a61-d94f-4ffa-9614-273989fd5f88 tempest-ServersNegativeTestJSON-1761324635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c659232-d83d-4191-975d-dad193673bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-205048366',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bea798e5-c19c-48ec-86a3-f7dcfa9ca8c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc1eeaa63fd243b7a32a2372315b01b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:40:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:40:14Z,use_quota=True,user_id='9bf7315821a0425098b354ad770f1605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:40:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-37953a61-d94f-4ffa-9614-273989fd5f88 tempest-ServersNegativeTestJSON-1761324635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba4e7061-280a-4e65-bbf8-ea89380b1760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:40:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-37953a61-d94f-4ffa-9614-273989fd5f88 tempest-ServersNegativeTestJSON-1761324635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba4e7061-280a-4e65-bbf8-ea89380b1760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:40:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-37953a61-d94f-4ffa-9614-273989fd5f88 tempest-ServersNegativeTestJSON-1761324635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a1b6bf2-7f19-4405-befc-2475e56fd75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:40:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-37953a61-d94f-4ffa-9614-273989fd5f88 tempest-ServersNegativeTestJSON-1761324635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a1b6bf2-7f19-4405-befc-2475e56fd75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bea798e5-c19c-48ec-86a3-f7dcfa9ca8c6', 'volume_name': 'volume-bea798e5-c19c-48ec-86a3-f7dcfa9ca8c6', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:40:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-37953a61-d94f-4ffa-9614-273989fd5f88 tempest-ServersNegativeTestJSON-1761324635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (202d0954-4e12-4fd3-adc3-25cb5a8b79f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:40:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-37953a61-d94f-4ffa-9614-273989fd5f88 tempest-ServersNegativeTestJSON-1761324635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (202d0954-4e12-4fd3-adc3-25cb5a8b79f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:40:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-37953a61-d94f-4ffa-9614-273989fd5f88 tempest-ServersNegativeTestJSON-1761324635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e6d1116-3cbe-44b5-a2ac-1ee570b00df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:40:14 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-37953a61-d94f-4ffa-9614-273989fd5f88 tempest-ServersNegativeTestJSON-1761324635 None] Volume bea798e5-c19c-48ec-86a3-f7dcfa9ca8c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bea798e5-c19c-48ec-86a3-f7dcfa9ca8c6', 'volume_size': 1}
Sep 18 11:40:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-37953a61-d94f-4ffa-9614-273989fd5f88 tempest-ServersNegativeTestJSON-1761324635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:40:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-37953a61-d94f-4ffa-9614-273989fd5f88 tempest-ServersNegativeTestJSON-1761324635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:40:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-37953a61-d94f-4ffa-9614-273989fd5f88 tempest-ServersNegativeTestJSON-1761324635 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-205048366',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bea798e5-c19c-48ec-86a3-f7dcfa9ca8c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc1eeaa63fd243b7a32a2372315b01b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:40:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:40:14Z,use_quota=True,user_id='9bf7315821a0425098b354ad770f1605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:40:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-37953a61-d94f-4ffa-9614-273989fd5f88 tempest-ServersNegativeTestJSON-1761324635 None] Creating volume bea798e5-c19c-48ec-86a3-f7dcfa9ca8c6 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:40:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-37953a61-d94f-4ffa-9614-273989fd5f88 tempest-ServersNegativeTestJSON-1761324635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:40:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-37953a61-d94f-4ffa-9614-273989fd5f88 tempest-ServersNegativeTestJSON-1761324635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:40:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-37953a61-d94f-4ffa-9614-273989fd5f88 tempest-ServersNegativeTestJSON-1761324635 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:40:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-37953a61-d94f-4ffa-9614-273989fd5f88 tempest-ServersNegativeTestJSON-1761324635 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:40:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-37953a61-d94f-4ffa-9614-273989fd5f88 tempest-ServersNegativeTestJSON-1761324635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:40:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-37953a61-d94f-4ffa-9614-273989fd5f88 tempest-ServersNegativeTestJSON-1761324635 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:40:14 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-37953a61-d94f-4ffa-9614-273989fd5f88 tempest-ServersNegativeTestJSON-1761324635 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:40:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-37953a61-d94f-4ffa-9614-273989fd5f88 tempest-ServersNegativeTestJSON-1761324635 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-bea798e5-c19c-48ec-86a3-f7dcfa9ca8c6 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:40:15 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=28, name=volume-bea798e5-c19c-48ec-86a3-f7dcfa9ca8c6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:40:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-37953a61-d94f-4ffa-9614-273989fd5f88 tempest-ServersNegativeTestJSON-1761324635 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-bea798e5-c19c-48ec-86a3-f7dcfa9ca8c6 1073741824" returned: 0 in 0.765s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:40:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-37953a61-d94f-4ffa-9614-273989fd5f88 tempest-ServersNegativeTestJSON-1761324635 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-bea798e5-c19c-48ec-86a3-f7dcfa9ca8c6 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:40:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-37953a61-d94f-4ffa-9614-273989fd5f88 tempest-ServersNegativeTestJSON-1761324635 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-bea798e5-c19c-48ec-86a3-f7dcfa9ca8c6" returned: 0 in 0.273s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:40:15 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-37953a61-d94f-4ffa-9614-273989fd5f88 tempest-ServersNegativeTestJSON-1761324635 None] <== create_volume: return (1170ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:40:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-37953a61-d94f-4ffa-9614-273989fd5f88 tempest-ServersNegativeTestJSON-1761324635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:40:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-37953a61-d94f-4ffa-9614-273989fd5f88 tempest-ServersNegativeTestJSON-1761324635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e6d1116-3cbe-44b5-a2ac-1ee570b00df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bea798e5-c19c-48ec-86a3-f7dcfa9ca8c6', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:40:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-37953a61-d94f-4ffa-9614-273989fd5f88 tempest-ServersNegativeTestJSON-1761324635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2b416fc-9339-4a66-a56d-47f7c91c67f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:40:16 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-37953a61-d94f-4ffa-9614-273989fd5f88 tempest-ServersNegativeTestJSON-1761324635 None] Volume volume-bea798e5-c19c-48ec-86a3-f7dcfa9ca8c6 (bea798e5-c19c-48ec-86a3-f7dcfa9ca8c6): created successfully
Sep 18 11:40:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-37953a61-d94f-4ffa-9614-273989fd5f88 tempest-ServersNegativeTestJSON-1761324635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2b416fc-9339-4a66-a56d-47f7c91c67f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:40:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-37953a61-d94f-4ffa-9614-273989fd5f88 tempest-ServersNegativeTestJSON-1761324635 None] Flow 'volume_create_manager' (846b161d-07e6-4b12-9a4d-5430adc5d14b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:40:16 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-37953a61-d94f-4ffa-9614-273989fd5f88 tempest-ServersNegativeTestJSON-1761324635 None] Created volume successfully.
Sep 18 11:40:20 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-b3ba8e14-2aa2-48c8-a5ab-6ed0ce848216 tempest-ServersNegativeTestJSON-1761324635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:40:20 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3ba8e14-2aa2-48c8-a5ab-6ed0ce848216 tempest-ServersNegativeTestJSON-1761324635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:40:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b3ba8e14-2aa2-48c8-a5ab-6ed0ce848216 tempest-ServersNegativeTestJSON-1761324635 None] Flow 'volume_create_manager' (5c62ae6b-cea5-4c25-9cec-ac2e4b6842c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:40:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b3ba8e14-2aa2-48c8-a5ab-6ed0ce848216 tempest-ServersNegativeTestJSON-1761324635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce58956d-8746-422a-8dcf-f6deea9a82e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:40:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b3ba8e14-2aa2-48c8-a5ab-6ed0ce848216 tempest-ServersNegativeTestJSON-1761324635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce58956d-8746-422a-8dcf-f6deea9a82e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-550184353',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afd8cc5f-01fa-48c9-89dd-e8a063a29b82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc1eeaa63fd243b7a32a2372315b01b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:40:20Z,use_quota=True,user_id='9bf7315821a0425098b354ad770f1605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:40:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b3ba8e14-2aa2-48c8-a5ab-6ed0ce848216 tempest-ServersNegativeTestJSON-1761324635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e1cbb0c-c6c1-490a-9424-68f62ccc72a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:40:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b3ba8e14-2aa2-48c8-a5ab-6ed0ce848216 tempest-ServersNegativeTestJSON-1761324635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e1cbb0c-c6c1-490a-9424-68f62ccc72a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:40:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b3ba8e14-2aa2-48c8-a5ab-6ed0ce848216 tempest-ServersNegativeTestJSON-1761324635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a1ffb29-8ca3-4505-8f47-89bfeb7b3829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:40:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b3ba8e14-2aa2-48c8-a5ab-6ed0ce848216 tempest-ServersNegativeTestJSON-1761324635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a1ffb29-8ca3-4505-8f47-89bfeb7b3829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afd8cc5f-01fa-48c9-89dd-e8a063a29b82', 'volume_name': 'volume-afd8cc5f-01fa-48c9-89dd-e8a063a29b82', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:40:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b3ba8e14-2aa2-48c8-a5ab-6ed0ce848216 tempest-ServersNegativeTestJSON-1761324635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e03ee1f-a92b-4acf-9957-7912fb7baa36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:40:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b3ba8e14-2aa2-48c8-a5ab-6ed0ce848216 tempest-ServersNegativeTestJSON-1761324635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e03ee1f-a92b-4acf-9957-7912fb7baa36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:40:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b3ba8e14-2aa2-48c8-a5ab-6ed0ce848216 tempest-ServersNegativeTestJSON-1761324635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16d0bf68-a18f-4561-837c-e15573700f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:40:21 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-b3ba8e14-2aa2-48c8-a5ab-6ed0ce848216 tempest-ServersNegativeTestJSON-1761324635 None] Volume afd8cc5f-01fa-48c9-89dd-e8a063a29b82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afd8cc5f-01fa-48c9-89dd-e8a063a29b82', 'volume_size': 1}
Sep 18 11:40:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-b3ba8e14-2aa2-48c8-a5ab-6ed0ce848216 tempest-ServersNegativeTestJSON-1761324635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:40:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-b3ba8e14-2aa2-48c8-a5ab-6ed0ce848216 tempest-ServersNegativeTestJSON-1761324635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:40:21 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-b3ba8e14-2aa2-48c8-a5ab-6ed0ce848216 tempest-ServersNegativeTestJSON-1761324635 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-550184353',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afd8cc5f-01fa-48c9-89dd-e8a063a29b82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc1eeaa63fd243b7a32a2372315b01b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:40:20Z,use_quota=True,user_id='9bf7315821a0425098b354ad770f1605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:40:21 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-b3ba8e14-2aa2-48c8-a5ab-6ed0ce848216 tempest-ServersNegativeTestJSON-1761324635 None] Creating volume afd8cc5f-01fa-48c9-89dd-e8a063a29b82 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:40:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-b3ba8e14-2aa2-48c8-a5ab-6ed0ce848216 tempest-ServersNegativeTestJSON-1761324635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:40:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-b3ba8e14-2aa2-48c8-a5ab-6ed0ce848216 tempest-ServersNegativeTestJSON-1761324635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:40:21 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-b3ba8e14-2aa2-48c8-a5ab-6ed0ce848216 tempest-ServersNegativeTestJSON-1761324635 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:40:21 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-b3ba8e14-2aa2-48c8-a5ab-6ed0ce848216 tempest-ServersNegativeTestJSON-1761324635 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:40:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-b3ba8e14-2aa2-48c8-a5ab-6ed0ce848216 tempest-ServersNegativeTestJSON-1761324635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:40:21 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-b3ba8e14-2aa2-48c8-a5ab-6ed0ce848216 tempest-ServersNegativeTestJSON-1761324635 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:40:21 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-b3ba8e14-2aa2-48c8-a5ab-6ed0ce848216 tempest-ServersNegativeTestJSON-1761324635 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:40:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b3ba8e14-2aa2-48c8-a5ab-6ed0ce848216 tempest-ServersNegativeTestJSON-1761324635 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-afd8cc5f-01fa-48c9-89dd-e8a063a29b82 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:40:21 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=29, name=volume-afd8cc5f-01fa-48c9-89dd-e8a063a29b82, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:40:21 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:40:21 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:40:22 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Flow 'volume_create_manager' (255e9e3f-e300-46f6-9649-03480d3b463f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:40:22 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f52364a5-7156-49f3-a1f9-5d2b23f53161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:40:22 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f52364a5-7156-49f3-a1f9-5d2b23f53161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-901564711',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=576035e9-0d69-4277-b052-e340b568186b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd889c61317b41acb4e9e2518d306745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:40:21Z,use_quota=True,user_id='b137e178dfaa41c7bb6065b543822540',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:40:22 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (648d8d5c-5751-469f-ba9d-80d48964e9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:40:22 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (648d8d5c-5751-469f-ba9d-80d48964e9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:40:22 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4cd0fb4-1ba5-4c57-a3fe-f0af1cc1fd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:40:22 devstack cinder-volume[83176]: DEBUG cinder.image.glance [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Creating Keystone auth plugin from conf {{(pid=83176) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 18 11:40:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b3ba8e14-2aa2-48c8-a5ab-6ed0ce848216 tempest-ServersNegativeTestJSON-1761324635 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-afd8cc5f-01fa-48c9-89dd-e8a063a29b82 1073741824" returned: 0 in 1.349s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:40:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b3ba8e14-2aa2-48c8-a5ab-6ed0ce848216 tempest-ServersNegativeTestJSON-1761324635 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-afd8cc5f-01fa-48c9-89dd-e8a063a29b82 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:40:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b3ba8e14-2aa2-48c8-a5ab-6ed0ce848216 tempest-ServersNegativeTestJSON-1761324635 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-afd8cc5f-01fa-48c9-89dd-e8a063a29b82" returned: 0 in 0.146s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:40:22 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-b3ba8e14-2aa2-48c8-a5ab-6ed0ce848216 tempest-ServersNegativeTestJSON-1761324635 None] <== create_volume: return (1564ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:40:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-b3ba8e14-2aa2-48c8-a5ab-6ed0ce848216 tempest-ServersNegativeTestJSON-1761324635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:40:23 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b3ba8e14-2aa2-48c8-a5ab-6ed0ce848216 tempest-ServersNegativeTestJSON-1761324635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16d0bf68-a18f-4561-837c-e15573700f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afd8cc5f-01fa-48c9-89dd-e8a063a29b82', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:40:23 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b3ba8e14-2aa2-48c8-a5ab-6ed0ce848216 tempest-ServersNegativeTestJSON-1761324635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5988a353-aa6c-436a-9259-549e85c2c8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:40:23 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-b3ba8e14-2aa2-48c8-a5ab-6ed0ce848216 tempest-ServersNegativeTestJSON-1761324635 None] Volume volume-afd8cc5f-01fa-48c9-89dd-e8a063a29b82 (afd8cc5f-01fa-48c9-89dd-e8a063a29b82): created successfully
Sep 18 11:40:23 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b3ba8e14-2aa2-48c8-a5ab-6ed0ce848216 tempest-ServersNegativeTestJSON-1761324635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5988a353-aa6c-436a-9259-549e85c2c8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:40:23 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b3ba8e14-2aa2-48c8-a5ab-6ed0ce848216 tempest-ServersNegativeTestJSON-1761324635 None] Flow 'volume_create_manager' (5c62ae6b-cea5-4c25-9cec-ac2e4b6842c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:40:23 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-b3ba8e14-2aa2-48c8-a5ab-6ed0ce848216 tempest-ServersNegativeTestJSON-1761324635 None] Created volume successfully.
Sep 18 11:40:23 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4cd0fb4-1ba5-4c57-a3fe-f0af1cc1fd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '576035e9-0d69-4277-b052-e340b568186b', 'volume_name': 'volume-576035e9-0d69-4277-b052-e340b568186b', 'volume_size': 1, 'image_id': 'd8f06519-8e17-49ea-ac0c-4df29f548619', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8f06519-8e17-49ea-ac0c-4df29f548619', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '68bc9b408b424a06a12482824dcdb45c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8f06519-8e17-49ea-ac0c-4df29f548619', 'created_at': datetime.datetime(2025, 9, 18, 9, 18, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 9, 18, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8f06519-8e17-49ea-ac0c-4df29f548619/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6ae49a0670>}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:40:23 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b75be57-6aa7-459c-b0b6-7ca117dbdb93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:40:23 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b75be57-6aa7-459c-b0b6-7ca117dbdb93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:40:23 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b45441e4-5ddd-427f-9115-2f8a272e296a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:40:23 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Volume 576035e9-0d69-4277-b052-e340b568186b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-576035e9-0d69-4277-b052-e340b568186b', 'volume_size': 1, 'image_id': 'd8f06519-8e17-49ea-ac0c-4df29f548619', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8f06519-8e17-49ea-ac0c-4df29f548619', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '68bc9b408b424a06a12482824dcdb45c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8f06519-8e17-49ea-ac0c-4df29f548619', 'created_at': datetime.datetime(2025, 9, 18, 9, 18, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 9, 18, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8f06519-8e17-49ea-ac0c-4df29f548619/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6ae49a0670>}
Sep 18 11:40:23 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Cloning 576035e9-0d69-4277-b052-e340b568186b from image d8f06519-8e17-49ea-ac0c-4df29f548619  at location (None, [{'url': 'file:///opt/stack/data/glance/images/d8f06519-8e17-49ea-ac0c-4df29f548619', 'metadata': {}}]). {{(pid=83176) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 18 11:40:24 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_q8sjjfzhdevstack@QuobyteHD, size 20.69 MB, duration 1.03 sec {{(pid=83176) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 18 11:40:24 devstack cinder-volume[83176]: INFO cinder.image.image_utils [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Image download 20.69 MB at 20.06 MB/s
Sep 18 11:40:24 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2303e2-a842-4acc-8a7b-7cf34f08f9ac]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:40:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_q8sjjfzhdevstack@QuobyteHD {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:40:25 devstack sudo[90661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_q8sjjfzhdevstack@QuobyteHD
Sep 18 11:40:25 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-045eb119-2633-42a8-853d-fe676a29c1e8 tempest-ServersNegativeTestJSON-1761324635 None] Acquiring lock "cinder-afd8cc5f-01fa-48c9-89dd-e8a063a29b82-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:40:25 devstack sudo[90661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:40:25 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-045eb119-2633-42a8-853d-fe676a29c1e8 tempest-ServersNegativeTestJSON-1761324635 None] Lock "cinder-afd8cc5f-01fa-48c9-89dd-e8a063a29b82-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:40:26 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-045eb119-2633-42a8-853d-fe676a29c1e8 tempest-ServersNegativeTestJSON-1761324635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:40:26 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-045eb119-2633-42a8-853d-fe676a29c1e8 tempest-ServersNegativeTestJSON-1761324635 None] Acquiring lock "cinder-quobyte-afd8cc5f-01fa-48c9-89dd-e8a063a29b82" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:40:26 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-045eb119-2633-42a8-853d-fe676a29c1e8 tempest-ServersNegativeTestJSON-1761324635 None] Lock "cinder-quobyte-afd8cc5f-01fa-48c9-89dd-e8a063a29b82" acquired by "delete_volume" :: waited 0.020s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:40:26 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[760ea28f-3f06-4c79-ba75-d032b7961a9a]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:40:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-045eb119-2633-42a8-853d-fe676a29c1e8 tempest-ServersNegativeTestJSON-1761324635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-afd8cc5f-01fa-48c9-89dd-e8a063a29b82 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:40:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-045eb119-2633-42a8-853d-fe676a29c1e8 tempest-ServersNegativeTestJSON-1761324635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-afd8cc5f-01fa-48c9-89dd-e8a063a29b82" returned: 0 in 0.745s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:40:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-045eb119-2633-42a8-853d-fe676a29c1e8 tempest-ServersNegativeTestJSON-1761324635 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-afd8cc5f-01fa-48c9-89dd-e8a063a29b82 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:40:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-045eb119-2633-42a8-853d-fe676a29c1e8 tempest-ServersNegativeTestJSON-1761324635 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-afd8cc5f-01fa-48c9-89dd-e8a063a29b82" returned: 0 in 0.117s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:40:27 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-045eb119-2633-42a8-853d-fe676a29c1e8 tempest-ServersNegativeTestJSON-1761324635 None] Lock "cinder-quobyte-afd8cc5f-01fa-48c9-89dd-e8a063a29b82" released by "delete_volume" :: held 1.072s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:40:27 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-045eb119-2633-42a8-853d-fe676a29c1e8 tempest-ServersNegativeTestJSON-1761324635 None] Created reservations ['4b819a8c-7bbc-49ff-ae56-59adbc06ff8b', '109d6e30-02a3-4f45-8b9a-7afd486ca89b', '1461f4bd-aa75-4172-9ee3-5ab2d3da9a80', '50505a88-e68a-4ad7-8974-f5028c54cdee'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:40:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-045eb119-2633-42a8-853d-fe676a29c1e8 tempest-ServersNegativeTestJSON-1761324635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:40:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-045eb119-2633-42a8-853d-fe676a29c1e8 tempest-ServersNegativeTestJSON-1761324635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:40:27 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-045eb119-2633-42a8-853d-fe676a29c1e8 tempest-ServersNegativeTestJSON-1761324635 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:40:27 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-045eb119-2633-42a8-853d-fe676a29c1e8 tempest-ServersNegativeTestJSON-1761324635 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:40:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-045eb119-2633-42a8-853d-fe676a29c1e8 tempest-ServersNegativeTestJSON-1761324635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:40:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-045eb119-2633-42a8-853d-fe676a29c1e8 tempest-ServersNegativeTestJSON-1761324635 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:40:28 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-9a03120f-dd94-460f-a33d-0bb33e09c52e tempest-ServersNegativeTestJSON-1761324635 None] Acquiring lock "cinder-bea798e5-c19c-48ec-86a3-f7dcfa9ca8c6-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:40:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-045eb119-2633-42a8-853d-fe676a29c1e8 tempest-ServersNegativeTestJSON-1761324635 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.495s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:40:28 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-045eb119-2633-42a8-853d-fe676a29c1e8 tempest-ServersNegativeTestJSON-1761324635 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:40:28 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-045eb119-2633-42a8-853d-fe676a29c1e8 tempest-ServersNegativeTestJSON-1761324635 None] Deleted volume successfully.
Sep 18 11:40:28 devstack sudo[90661]: pam_unix(sudo:session): session closed for user root
Sep 18 11:40:28 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-9a03120f-dd94-460f-a33d-0bb33e09c52e tempest-ServersNegativeTestJSON-1761324635 None] Lock "cinder-bea798e5-c19c-48ec-86a3-f7dcfa9ca8c6-delete_volume" acquired by "delete_volume" :: waited 0.354s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:40:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_q8sjjfzhdevstack@QuobyteHD" returned: 0 in 3.761s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:40:28 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Temporary image d8f06519-8e17-49ea-ac0c-4df29f548619 is fetched for user b137e178dfaa41c7bb6065b543822540. {{(pid=83176) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 18 11:40:28 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-045eb119-2633-42a8-853d-fe676a29c1e8 tempest-ServersNegativeTestJSON-1761324635 None] Lock "cinder-afd8cc5f-01fa-48c9-89dd-e8a063a29b82-delete_volume" released by "delete_volume" :: held 2.749s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:40:28 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-9a03120f-dd94-460f-a33d-0bb33e09c52e tempest-ServersNegativeTestJSON-1761324635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:40:28 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-9a03120f-dd94-460f-a33d-0bb33e09c52e tempest-ServersNegativeTestJSON-1761324635 None] Acquiring lock "cinder-quobyte-bea798e5-c19c-48ec-86a3-f7dcfa9ca8c6" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:40:28 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-9a03120f-dd94-460f-a33d-0bb33e09c52e tempest-ServersNegativeTestJSON-1761324635 None] Lock "cinder-quobyte-bea798e5-c19c-48ec-86a3-f7dcfa9ca8c6" acquired by "delete_volume" :: waited 0.014s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:40:28 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e896eb98-68b2-4aed-940a-5bc0cde3f933]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:40:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9a03120f-dd94-460f-a33d-0bb33e09c52e tempest-ServersNegativeTestJSON-1761324635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-bea798e5-c19c-48ec-86a3-f7dcfa9ca8c6 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:40:28 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[145feffb-0447-4b1f-b340-f2dd40f22d99]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:40:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_q8sjjfzhdevstack@QuobyteHD {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:40:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9a03120f-dd94-460f-a33d-0bb33e09c52e tempest-ServersNegativeTestJSON-1761324635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-bea798e5-c19c-48ec-86a3-f7dcfa9ca8c6" returned: 0 in 0.561s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:40:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9a03120f-dd94-460f-a33d-0bb33e09c52e tempest-ServersNegativeTestJSON-1761324635 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-bea798e5-c19c-48ec-86a3-f7dcfa9ca8c6 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:40:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9a03120f-dd94-460f-a33d-0bb33e09c52e tempest-ServersNegativeTestJSON-1761324635 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-bea798e5-c19c-48ec-86a3-f7dcfa9ca8c6" returned: 0 in 0.096s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:40:29 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-9a03120f-dd94-460f-a33d-0bb33e09c52e tempest-ServersNegativeTestJSON-1761324635 None] Lock "cinder-quobyte-bea798e5-c19c-48ec-86a3-f7dcfa9ca8c6" released by "delete_volume" :: held 0.829s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:40:29 devstack sudo[90672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_q8sjjfzhdevstack@QuobyteHD
Sep 18 11:40:29 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:40:29 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-9a03120f-dd94-460f-a33d-0bb33e09c52e tempest-ServersNegativeTestJSON-1761324635 None] Created reservations ['df6b35b9-153b-4e00-b20a-4cdb87df0227', 'b111053b-ced6-47ba-b66e-67531ed6a5c2', '6111d68c-fbc5-4163-af78-a860fbdbe03f', '5b11fd86-0309-4e64-9637-855c8e503d88'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:40:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-9a03120f-dd94-460f-a33d-0bb33e09c52e tempest-ServersNegativeTestJSON-1761324635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:40:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-9a03120f-dd94-460f-a33d-0bb33e09c52e tempest-ServersNegativeTestJSON-1761324635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:40:29 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-9a03120f-dd94-460f-a33d-0bb33e09c52e tempest-ServersNegativeTestJSON-1761324635 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:40:29 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-9a03120f-dd94-460f-a33d-0bb33e09c52e tempest-ServersNegativeTestJSON-1761324635 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:40:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-9a03120f-dd94-460f-a33d-0bb33e09c52e tempest-ServersNegativeTestJSON-1761324635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:40:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9a03120f-dd94-460f-a33d-0bb33e09c52e tempest-ServersNegativeTestJSON-1761324635 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:40:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9a03120f-dd94-460f-a33d-0bb33e09c52e tempest-ServersNegativeTestJSON-1761324635 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.126s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:40:30 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-9a03120f-dd94-460f-a33d-0bb33e09c52e tempest-ServersNegativeTestJSON-1761324635 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:40:30 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-9a03120f-dd94-460f-a33d-0bb33e09c52e tempest-ServersNegativeTestJSON-1761324635 None] Deleted volume successfully.
Sep 18 11:40:30 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-9a03120f-dd94-460f-a33d-0bb33e09c52e tempest-ServersNegativeTestJSON-1761324635 None] Lock "cinder-bea798e5-c19c-48ec-86a3-f7dcfa9ca8c6-delete_volume" released by "delete_volume" :: held 2.110s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:40:32 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root
Sep 18 11:40:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_q8sjjfzhdevstack@QuobyteHD" returned: 0 in 3.290s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:40:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:40:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.056s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:40:32 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-901564711',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=576035e9-0d69-4277-b052-e340b568186b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd889c61317b41acb4e9e2518d306745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:40:21Z,use_quota=True,user_id='b137e178dfaa41c7bb6065b543822540',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:40:32 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Creating volume 576035e9-0d69-4277-b052-e340b568186b {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:40:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:40:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:40:32 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:40:32 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:40:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:40:32 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:40:32 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:40:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-576035e9-0d69-4277-b052-e340b568186b 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:40:33 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=30, name=volume-576035e9-0d69-4277-b052-e340b568186b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:40:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-576035e9-0d69-4277-b052-e340b568186b 1073741824" returned: 0 in 1.811s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:40:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-576035e9-0d69-4277-b052-e340b568186b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:40:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-576035e9-0d69-4277-b052-e340b568186b" returned: 0 in 0.347s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:40:34 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] <== create_volume: return (2279ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:40:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.412s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:40:34 devstack cinder-volume[83176]: DEBUG cinder.volume.volume_utils [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Attempting download of d8f06519-8e17-49ea-ac0c-4df29f548619 ((None, [{'url': 'file:///opt/stack/data/glance/images/d8f06519-8e17-49ea-ac0c-4df29f548619', 'metadata': {}}])) to volume 576035e9-0d69-4277-b052-e340b568186b. {{(pid=83176) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 18 11:40:35 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e0cb49-eb8a-45b5-957f-7878d0142919]: (4, 'raw') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:40:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8f06519-8e17-49ea-ac0c-4df29f548619_7lf12itm {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:40:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8f06519-8e17-49ea-ac0c-4df29f548619_7lf12itm" returned: 0 in 0.856s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:40:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8f06519-8e17-49ea-ac0c-4df29f548619_7lf12itm {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:40:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8f06519-8e17-49ea-ac0c-4df29f548619_7lf12itm" returned: 1 in 0.642s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:40:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8f06519-8e17-49ea-ac0c-4df29f548619_7lf12itm' failed. Not Retrying. {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 11:40:36 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4156d2-a7e5-4d91-b442-aaa981d1a06a]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:40:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_q8sjjfzhdevstack@QuobyteHD {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:40:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_q8sjjfzhdevstack@QuobyteHD" returned: 0 in 1.022s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:40:37 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] d8f06519-8e17-49ea-ac0c-4df29f548619 was qcow2, converting to raw {{(pid=83176) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 18 11:40:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_q8sjjfzhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-576035e9-0d69-4277-b052-e340b568186b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:40:38 devstack quobyte-client[83193]: System call of process 90745 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:40:38 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=30, name=volume-576035e9-0d69-4277-b052-e340b568186b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:40:39 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_q8sjjfzhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-576035e9-0d69-4277-b052-e340b568186b" returned: 0 in 1.743s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:40:39 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_q8sjjfzhdevstack@QuobyteHD, size 112.00 MB, duration 1.78 sec, destination /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-576035e9-0d69-4277-b052-e340b568186b {{(pid=83176) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 11:40:39 devstack cinder-volume[83176]: INFO cinder.image.image_utils [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Converted 112.00 MB image at 62.98 MB/s
Sep 18 11:40:39 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-576035e9-0d69-4277-b052-e340b568186b 1G {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:40:39 devstack quobyte-client[83193]: System call of process 90761 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:40:39 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-576035e9-0d69-4277-b052-e340b568186b 1G" returned: 0 in 0.143s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:40:40 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[238c9f44-53cd-4cdb-8e1c-1f2fdf541661]: (4, 'raw') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:40:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-576035e9-0d69-4277-b052-e340b568186b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:40:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-576035e9-0d69-4277-b052-e340b568186b" returned: 0 in 0.627s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:40:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-576035e9-0d69-4277-b052-e340b568186b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:40:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-576035e9-0d69-4277-b052-e340b568186b" returned: 1 in 0.447s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:40:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-576035e9-0d69-4277-b052-e340b568186b' failed. Not Retrying. {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 11:40:41 devstack cinder-volume[83176]: DEBUG cinder.volume.volume_utils [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Downloaded image d8f06519-8e17-49ea-ac0c-4df29f548619 ((None, [{'url': 'file:///opt/stack/data/glance/images/d8f06519-8e17-49ea-ac0c-4df29f548619', 'metadata': {}}])) to volume 576035e9-0d69-4277-b052-e340b568186b successfully. {{(pid=83176) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 18 11:40:41 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Temporary image d8f06519-8e17-49ea-ac0c-4df29f548619 for user b137e178dfaa41c7bb6065b543822540 is deleted. {{(pid=83176) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 18 11:40:41 devstack cinder-volume[83176]: DEBUG cinder.volume.volume_utils [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Marking volume 576035e9-0d69-4277-b052-e340b568186b as bootable. {{(pid=83176) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 18 11:40:41 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Copying metadata from image d8f06519-8e17-49ea-ac0c-4df29f548619 to 576035e9-0d69-4277-b052-e340b568186b. {{(pid=83176) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 18 11:40:41 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Creating volume glance metadata for volume 576035e9-0d69-4277-b052-e340b568186b backed by image d8f06519-8e17-49ea-ac0c-4df29f548619 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd8f06519-8e17-49ea-ac0c-4df29f548619', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83176) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 18 11:40:41 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b45441e4-5ddd-427f-9115-2f8a272e296a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-576035e9-0d69-4277-b052-e340b568186b', 'volume_size': 1, 'image_id': 'd8f06519-8e17-49ea-ac0c-4df29f548619', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8f06519-8e17-49ea-ac0c-4df29f548619', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '68bc9b408b424a06a12482824dcdb45c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8f06519-8e17-49ea-ac0c-4df29f548619', 'created_at': datetime.datetime(2025, 9, 18, 9, 18, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 9, 18, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8f06519-8e17-49ea-ac0c-4df29f548619/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6ae49a0670>}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:40:41 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b9d3874-d10f-48a2-b56e-f655b5260c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:40:41 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Volume volume-576035e9-0d69-4277-b052-e340b568186b (576035e9-0d69-4277-b052-e340b568186b): created successfully
Sep 18 11:40:41 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b9d3874-d10f-48a2-b56e-f655b5260c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:40:41 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Flow 'volume_create_manager' (255e9e3f-e300-46f6-9649-03480d3b463f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:40:41 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-f3040eb4-e7b3-44a3-a2ab-4b8bdad59ae2 tempest-VolumesImageMetadata-964290808 None] Created volume successfully.
Sep 18 11:40:42 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-b47c3074-8fa5-409e-a986-5368a717da5f tempest-VolumesImageMetadata-964290808 None] Acquiring lock "cinder-576035e9-0d69-4277-b052-e340b568186b-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:40:42 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-b47c3074-8fa5-409e-a986-5368a717da5f tempest-VolumesImageMetadata-964290808 None] Lock "cinder-576035e9-0d69-4277-b052-e340b568186b-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:40:42 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-b47c3074-8fa5-409e-a986-5368a717da5f tempest-VolumesImageMetadata-964290808 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:40:42 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-b47c3074-8fa5-409e-a986-5368a717da5f tempest-VolumesImageMetadata-964290808 None] Acquiring lock "cinder-quobyte-576035e9-0d69-4277-b052-e340b568186b" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:40:42 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-b47c3074-8fa5-409e-a986-5368a717da5f tempest-VolumesImageMetadata-964290808 None] Lock "cinder-quobyte-576035e9-0d69-4277-b052-e340b568186b" acquired by "delete_volume" :: waited 0.021s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:40:42 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd08a861-e263-4419-9cc0-29d81d51804c]: (4, 'raw') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:40:42 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b47c3074-8fa5-409e-a986-5368a717da5f tempest-VolumesImageMetadata-964290808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-576035e9-0d69-4277-b052-e340b568186b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:40:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b47c3074-8fa5-409e-a986-5368a717da5f tempest-VolumesImageMetadata-964290808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-576035e9-0d69-4277-b052-e340b568186b" returned: 0 in 0.465s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:40:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b47c3074-8fa5-409e-a986-5368a717da5f tempest-VolumesImageMetadata-964290808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-576035e9-0d69-4277-b052-e340b568186b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:40:43 devstack quobyte-client[83193]: System call of process 90785 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:40:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b47c3074-8fa5-409e-a986-5368a717da5f tempest-VolumesImageMetadata-964290808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-576035e9-0d69-4277-b052-e340b568186b" returned: 1 in 0.464s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:40:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b47c3074-8fa5-409e-a986-5368a717da5f tempest-VolumesImageMetadata-964290808 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-576035e9-0d69-4277-b052-e340b568186b' failed. Not Retrying. {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 11:40:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b47c3074-8fa5-409e-a986-5368a717da5f tempest-VolumesImageMetadata-964290808 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-576035e9-0d69-4277-b052-e340b568186b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:40:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b47c3074-8fa5-409e-a986-5368a717da5f tempest-VolumesImageMetadata-964290808 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-576035e9-0d69-4277-b052-e340b568186b" returned: 0 in 0.109s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:40:44 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-b47c3074-8fa5-409e-a986-5368a717da5f tempest-VolumesImageMetadata-964290808 None] Lock "cinder-quobyte-576035e9-0d69-4277-b052-e340b568186b" released by "delete_volume" :: held 1.346s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:40:44 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-b47c3074-8fa5-409e-a986-5368a717da5f tempest-VolumesImageMetadata-964290808 None] Created reservations ['e985e3f8-0b8e-4bfd-86e0-96dba903e2d3', '8b5e1c4b-3eae-4ed3-8400-830ee795c355', '883902e7-8d95-4f28-b472-fda456a7a1d1', '7096ab3d-42ad-4042-8cec-8b6392d7dc4e'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:40:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-b47c3074-8fa5-409e-a986-5368a717da5f tempest-VolumesImageMetadata-964290808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:40:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-b47c3074-8fa5-409e-a986-5368a717da5f tempest-VolumesImageMetadata-964290808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:40:44 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-b47c3074-8fa5-409e-a986-5368a717da5f tempest-VolumesImageMetadata-964290808 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:40:44 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-b47c3074-8fa5-409e-a986-5368a717da5f tempest-VolumesImageMetadata-964290808 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:40:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-b47c3074-8fa5-409e-a986-5368a717da5f tempest-VolumesImageMetadata-964290808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:40:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b47c3074-8fa5-409e-a986-5368a717da5f tempest-VolumesImageMetadata-964290808 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:40:45 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b47c3074-8fa5-409e-a986-5368a717da5f tempest-VolumesImageMetadata-964290808 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.203s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:40:45 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-b47c3074-8fa5-409e-a986-5368a717da5f tempest-VolumesImageMetadata-964290808 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:40:45 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-b47c3074-8fa5-409e-a986-5368a717da5f tempest-VolumesImageMetadata-964290808 None] Deleted volume successfully.
Sep 18 11:40:45 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-b47c3074-8fa5-409e-a986-5368a717da5f tempest-VolumesImageMetadata-964290808 None] Lock "cinder-576035e9-0d69-4277-b052-e340b568186b-delete_volume" released by "delete_volume" :: held 2.815s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:40:49 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-d044df07-84d1-46b3-97e9-be0879d55b52 tempest-SnapshotMetadataTestJSON-881258191 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:40:49 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-d044df07-84d1-46b3-97e9-be0879d55b52 tempest-SnapshotMetadataTestJSON-881258191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:40:49 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d044df07-84d1-46b3-97e9-be0879d55b52 tempest-SnapshotMetadataTestJSON-881258191 None] Flow 'volume_create_manager' (15fc6b62-c03c-4ed8-8016-77e44fc7fb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:40:49 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d044df07-84d1-46b3-97e9-be0879d55b52 tempest-SnapshotMetadataTestJSON-881258191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a0ce6d-2b20-419a-b45c-67a8a5d4cf8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:40:49 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d044df07-84d1-46b3-97e9-be0879d55b52 tempest-SnapshotMetadataTestJSON-881258191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a0ce6d-2b20-419a-b45c-67a8a5d4cf8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-222202420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b50f4648-45e5-4e80-a587-d116bad564c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b181eb10e1174c7a867b5e21bcd5b682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:40:49Z,use_quota=True,user_id='73dbf8db0f304104a2e5c0872e20a961',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:40:49 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d044df07-84d1-46b3-97e9-be0879d55b52 tempest-SnapshotMetadataTestJSON-881258191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a00ee7c-eb40-419a-bd89-ecca42c6baea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:40:49 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d044df07-84d1-46b3-97e9-be0879d55b52 tempest-SnapshotMetadataTestJSON-881258191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a00ee7c-eb40-419a-bd89-ecca42c6baea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:40:49 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d044df07-84d1-46b3-97e9-be0879d55b52 tempest-SnapshotMetadataTestJSON-881258191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e3ae7a3-4682-4ea1-9112-791ab4a71c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:40:49 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d044df07-84d1-46b3-97e9-be0879d55b52 tempest-SnapshotMetadataTestJSON-881258191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e3ae7a3-4682-4ea1-9112-791ab4a71c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b50f4648-45e5-4e80-a587-d116bad564c9', 'volume_name': 'volume-b50f4648-45e5-4e80-a587-d116bad564c9', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:40:49 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d044df07-84d1-46b3-97e9-be0879d55b52 tempest-SnapshotMetadataTestJSON-881258191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba2e205f-5292-4272-9f89-a469dff56edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:40:49 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d044df07-84d1-46b3-97e9-be0879d55b52 tempest-SnapshotMetadataTestJSON-881258191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba2e205f-5292-4272-9f89-a469dff56edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:40:49 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d044df07-84d1-46b3-97e9-be0879d55b52 tempest-SnapshotMetadataTestJSON-881258191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1baf1033-0120-499e-9659-6757db0d9ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:40:49 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-d044df07-84d1-46b3-97e9-be0879d55b52 tempest-SnapshotMetadataTestJSON-881258191 None] Volume b50f4648-45e5-4e80-a587-d116bad564c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b50f4648-45e5-4e80-a587-d116bad564c9', 'volume_size': 1}
Sep 18 11:40:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d044df07-84d1-46b3-97e9-be0879d55b52 tempest-SnapshotMetadataTestJSON-881258191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:40:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d044df07-84d1-46b3-97e9-be0879d55b52 tempest-SnapshotMetadataTestJSON-881258191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:40:49 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-d044df07-84d1-46b3-97e9-be0879d55b52 tempest-SnapshotMetadataTestJSON-881258191 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-222202420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b50f4648-45e5-4e80-a587-d116bad564c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b181eb10e1174c7a867b5e21bcd5b682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:40:49Z,use_quota=True,user_id='73dbf8db0f304104a2e5c0872e20a961',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:40:49 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-d044df07-84d1-46b3-97e9-be0879d55b52 tempest-SnapshotMetadataTestJSON-881258191 None] Creating volume b50f4648-45e5-4e80-a587-d116bad564c9 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:40:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d044df07-84d1-46b3-97e9-be0879d55b52 tempest-SnapshotMetadataTestJSON-881258191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:40:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d044df07-84d1-46b3-97e9-be0879d55b52 tempest-SnapshotMetadataTestJSON-881258191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:40:49 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-d044df07-84d1-46b3-97e9-be0879d55b52 tempest-SnapshotMetadataTestJSON-881258191 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:40:49 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-d044df07-84d1-46b3-97e9-be0879d55b52 tempest-SnapshotMetadataTestJSON-881258191 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:40:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d044df07-84d1-46b3-97e9-be0879d55b52 tempest-SnapshotMetadataTestJSON-881258191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:40:49 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-d044df07-84d1-46b3-97e9-be0879d55b52 tempest-SnapshotMetadataTestJSON-881258191 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:40:49 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-d044df07-84d1-46b3-97e9-be0879d55b52 tempest-SnapshotMetadataTestJSON-881258191 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:40:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d044df07-84d1-46b3-97e9-be0879d55b52 tempest-SnapshotMetadataTestJSON-881258191 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b50f4648-45e5-4e80-a587-d116bad564c9 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:40:50 devstack quobyte-client[83193]: System call of process 90791 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:40:50 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=31, name=volume-b50f4648-45e5-4e80-a587-d116bad564c9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:40:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d044df07-84d1-46b3-97e9-be0879d55b52 tempest-SnapshotMetadataTestJSON-881258191 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b50f4648-45e5-4e80-a587-d116bad564c9 1073741824" returned: 0 in 0.461s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:40:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d044df07-84d1-46b3-97e9-be0879d55b52 tempest-SnapshotMetadataTestJSON-881258191 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b50f4648-45e5-4e80-a587-d116bad564c9 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:40:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d044df07-84d1-46b3-97e9-be0879d55b52 tempest-SnapshotMetadataTestJSON-881258191 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b50f4648-45e5-4e80-a587-d116bad564c9" returned: 0 in 0.146s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:40:50 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-d044df07-84d1-46b3-97e9-be0879d55b52 tempest-SnapshotMetadataTestJSON-881258191 None] <== create_volume: return (759ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:40:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d044df07-84d1-46b3-97e9-be0879d55b52 tempest-SnapshotMetadataTestJSON-881258191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:40:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d044df07-84d1-46b3-97e9-be0879d55b52 tempest-SnapshotMetadataTestJSON-881258191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1baf1033-0120-499e-9659-6757db0d9ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b50f4648-45e5-4e80-a587-d116bad564c9', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:40:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d044df07-84d1-46b3-97e9-be0879d55b52 tempest-SnapshotMetadataTestJSON-881258191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ffc440-2618-4d42-a3e1-5292bd492ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:40:50 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-d044df07-84d1-46b3-97e9-be0879d55b52 tempest-SnapshotMetadataTestJSON-881258191 None] Volume volume-b50f4648-45e5-4e80-a587-d116bad564c9 (b50f4648-45e5-4e80-a587-d116bad564c9): created successfully
Sep 18 11:40:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d044df07-84d1-46b3-97e9-be0879d55b52 tempest-SnapshotMetadataTestJSON-881258191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ffc440-2618-4d42-a3e1-5292bd492ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:40:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d044df07-84d1-46b3-97e9-be0879d55b52 tempest-SnapshotMetadataTestJSON-881258191 None] Flow 'volume_create_manager' (15fc6b62-c03c-4ed8-8016-77e44fc7fb70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:40:51 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-d044df07-84d1-46b3-97e9-be0879d55b52 tempest-SnapshotMetadataTestJSON-881258191 None] Created volume successfully.
Sep 18 11:40:52 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-691630be-7bbe-4e7f-acbf-6acc6276c2ec tempest-SnapshotMetadataTestJSON-881258191 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:40:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-691630be-7bbe-4e7f-acbf-6acc6276c2ec tempest-SnapshotMetadataTestJSON-881258191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:40:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-691630be-7bbe-4e7f-acbf-6acc6276c2ec tempest-SnapshotMetadataTestJSON-881258191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:40:52 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-691630be-7bbe-4e7f-acbf-6acc6276c2ec tempest-SnapshotMetadataTestJSON-881258191 None] Creating offline snapshot 26c35e5a-3bc9-470c-bca8-b51efdb37d89 of volume b50f4648-45e5-4e80-a587-d116bad564c9 {{(pid=83176) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 11:40:52 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[262657c7-a16c-4304-bfd5-751d00962df9]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:40:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-691630be-7bbe-4e7f-acbf-6acc6276c2ec tempest-SnapshotMetadataTestJSON-881258191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b50f4648-45e5-4e80-a587-d116bad564c9 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:40:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-691630be-7bbe-4e7f-acbf-6acc6276c2ec tempest-SnapshotMetadataTestJSON-881258191 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b50f4648-45e5-4e80-a587-d116bad564c9" returned: 0 in 0.812s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:40:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-691630be-7bbe-4e7f-acbf-6acc6276c2ec tempest-SnapshotMetadataTestJSON-881258191 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b50f4648-45e5-4e80-a587-d116bad564c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b50f4648-45e5-4e80-a587-d116bad564c9.26c35e5a-3bc9-470c-bca8-b51efdb37d89 1G {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:40:53 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=32, name=volume-b50f4648-45e5-4e80-a587-d116bad564c9.26c35e5a-3bc9-470c-bca8-b51efdb37d89, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:40:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-691630be-7bbe-4e7f-acbf-6acc6276c2ec tempest-SnapshotMetadataTestJSON-881258191 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b50f4648-45e5-4e80-a587-d116bad564c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b50f4648-45e5-4e80-a587-d116bad564c9.26c35e5a-3bc9-470c-bca8-b51efdb37d89 1G" returned: 0 in 0.473s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:40:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-691630be-7bbe-4e7f-acbf-6acc6276c2ec tempest-SnapshotMetadataTestJSON-881258191 None] Running cmd (subprocess): qemu-img rebase -u -b volume-b50f4648-45e5-4e80-a587-d116bad564c9 -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b50f4648-45e5-4e80-a587-d116bad564c9.26c35e5a-3bc9-470c-bca8-b51efdb37d89 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:40:54 devstack quobyte-client[83193]: System call of process 90805 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:40:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-691630be-7bbe-4e7f-acbf-6acc6276c2ec tempest-SnapshotMetadataTestJSON-881258191 None] CMD "qemu-img rebase -u -b volume-b50f4648-45e5-4e80-a587-d116bad564c9 -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b50f4648-45e5-4e80-a587-d116bad564c9.26c35e5a-3bc9-470c-bca8-b51efdb37d89" returned: 0 in 0.276s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:40:54 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-691630be-7bbe-4e7f-acbf-6acc6276c2ec tempest-SnapshotMetadataTestJSON-881258191 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b50f4648-45e5-4e80-a587-d116bad564c9.26c35e5a-3bc9-470c-bca8-b51efdb37d89 is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 11:40:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-691630be-7bbe-4e7f-acbf-6acc6276c2ec tempest-SnapshotMetadataTestJSON-881258191 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b50f4648-45e5-4e80-a587-d116bad564c9.26c35e5a-3bc9-470c-bca8-b51efdb37d89 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:40:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-691630be-7bbe-4e7f-acbf-6acc6276c2ec tempest-SnapshotMetadataTestJSON-881258191 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b50f4648-45e5-4e80-a587-d116bad564c9.26c35e5a-3bc9-470c-bca8-b51efdb37d89" returned: 0 in 0.274s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:40:54 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-691630be-7bbe-4e7f-acbf-6acc6276c2ec tempest-SnapshotMetadataTestJSON-881258191 None] Setting permissions: /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b50f4648-45e5-4e80-a587-d116bad564c9 -> 1000:1000 {{(pid=83176) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 11:40:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-691630be-7bbe-4e7f-acbf-6acc6276c2ec tempest-SnapshotMetadataTestJSON-881258191 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b50f4648-45e5-4e80-a587-d116bad564c9 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b50f4648-45e5-4e80-a587-d116bad564c9.26c35e5a-3bc9-470c-bca8-b51efdb37d89 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:40:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-691630be-7bbe-4e7f-acbf-6acc6276c2ec tempest-SnapshotMetadataTestJSON-881258191 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b50f4648-45e5-4e80-a587-d116bad564c9 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b50f4648-45e5-4e80-a587-d116bad564c9.26c35e5a-3bc9-470c-bca8-b51efdb37d89" returned: 0 in 0.359s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:40:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-691630be-7bbe-4e7f-acbf-6acc6276c2ec tempest-SnapshotMetadataTestJSON-881258191 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b50f4648-45e5-4e80-a587-d116bad564c9.info {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:40:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-691630be-7bbe-4e7f-acbf-6acc6276c2ec tempest-SnapshotMetadataTestJSON-881258191 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b50f4648-45e5-4e80-a587-d116bad564c9.info" returned: 0 in 0.499s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:40:55 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-691630be-7bbe-4e7f-acbf-6acc6276c2ec tempest-SnapshotMetadataTestJSON-881258191 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b50f4648-45e5-4e80-a587-d116bad564c9.info is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 11:40:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-691630be-7bbe-4e7f-acbf-6acc6276c2ec tempest-SnapshotMetadataTestJSON-881258191 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b50f4648-45e5-4e80-a587-d116bad564c9.info {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:40:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-691630be-7bbe-4e7f-acbf-6acc6276c2ec tempest-SnapshotMetadataTestJSON-881258191 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b50f4648-45e5-4e80-a587-d116bad564c9.info" returned: 0 in 0.150s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:40:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-691630be-7bbe-4e7f-acbf-6acc6276c2ec tempest-SnapshotMetadataTestJSON-881258191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.613s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:40:56 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-691630be-7bbe-4e7f-acbf-6acc6276c2ec tempest-SnapshotMetadataTestJSON-881258191 None] Create snapshot completed successfully
Sep 18 11:40:58 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-40e7cb12-ab78-4e2f-a102-815df1443ce6 tempest-SnapshotMetadataTestJSON-881258191 None] Acquiring lock "cinder-26c35e5a-3bc9-470c-bca8-b51efdb37d89-delete_snapshot" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:40:58 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-40e7cb12-ab78-4e2f-a102-815df1443ce6 tempest-SnapshotMetadataTestJSON-881258191 None] Lock "cinder-26c35e5a-3bc9-470c-bca8-b51efdb37d89-delete_snapshot" acquired by "delete_snapshot" :: waited 0.087s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:40:58 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-40e7cb12-ab78-4e2f-a102-815df1443ce6 tempest-SnapshotMetadataTestJSON-881258191 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:40:58 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-40e7cb12-ab78-4e2f-a102-815df1443ce6 tempest-SnapshotMetadataTestJSON-881258191 None] Acquiring lock "cinder-quobyte-b50f4648-45e5-4e80-a587-d116bad564c9" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:40:58 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-40e7cb12-ab78-4e2f-a102-815df1443ce6 tempest-SnapshotMetadataTestJSON-881258191 None] Lock "cinder-quobyte-b50f4648-45e5-4e80-a587-d116bad564c9" acquired by "delete_snapshot" :: waited 0.062s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:40:58 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-40e7cb12-ab78-4e2f-a102-815df1443ce6 tempest-SnapshotMetadataTestJSON-881258191 None] Acquiring lock "cinder-quobyte-26c35e5a-3bc9-470c-bca8-b51efdb37d89" by "_delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:40:58 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-40e7cb12-ab78-4e2f-a102-815df1443ce6 tempest-SnapshotMetadataTestJSON-881258191 None] Lock "cinder-quobyte-26c35e5a-3bc9-470c-bca8-b51efdb37d89" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:40:58 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-40e7cb12-ab78-4e2f-a102-815df1443ce6 tempest-SnapshotMetadataTestJSON-881258191 None] Deleting offline snapshot 26c35e5a-3bc9-470c-bca8-b51efdb37d89 of volume b50f4648-45e5-4e80-a587-d116bad564c9 {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 11:40:58 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-40e7cb12-ab78-4e2f-a102-815df1443ce6 tempest-SnapshotMetadataTestJSON-881258191 None] snapshot_file for this snap is: volume-b50f4648-45e5-4e80-a587-d116bad564c9.26c35e5a-3bc9-470c-bca8-b51efdb37d89 {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 11:40:58 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[938546f5-9deb-4174-8a23-b061a62efca6]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:40:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-40e7cb12-ab78-4e2f-a102-815df1443ce6 tempest-SnapshotMetadataTestJSON-881258191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b50f4648-45e5-4e80-a587-d116bad564c9.26c35e5a-3bc9-470c-bca8-b51efdb37d89 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:40:59 devstack quobyte-client[83193]: System call of process 90861 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:40:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-40e7cb12-ab78-4e2f-a102-815df1443ce6 tempest-SnapshotMetadataTestJSON-881258191 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b50f4648-45e5-4e80-a587-d116bad564c9.26c35e5a-3bc9-470c-bca8-b51efdb37d89" returned: 0 in 1.020s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:40:59 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-40e7cb12-ab78-4e2f-a102-815df1443ce6 tempest-SnapshotMetadataTestJSON-881258191 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b50f4648-45e5-4e80-a587-d116bad564c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 11:41:00 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e94ecb-464f-42ea-9ff4-9e650d49f1fd]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:41:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-40e7cb12-ab78-4e2f-a102-815df1443ce6 tempest-SnapshotMetadataTestJSON-881258191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b50f4648-45e5-4e80-a587-d116bad564c9 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:41:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-40e7cb12-ab78-4e2f-a102-815df1443ce6 tempest-SnapshotMetadataTestJSON-881258191 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b50f4648-45e5-4e80-a587-d116bad564c9" returned: 0 in 0.791s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:41:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-40e7cb12-ab78-4e2f-a102-815df1443ce6 tempest-SnapshotMetadataTestJSON-881258191 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b50f4648-45e5-4e80-a587-d116bad564c9.26c35e5a-3bc9-470c-bca8-b51efdb37d89 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:41:01 devstack quobyte-client[83193]: System call of process 90873 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:41:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-40e7cb12-ab78-4e2f-a102-815df1443ce6 tempest-SnapshotMetadataTestJSON-881258191 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b50f4648-45e5-4e80-a587-d116bad564c9.26c35e5a-3bc9-470c-bca8-b51efdb37d89" returned: 0 in 0.390s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:41:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-40e7cb12-ab78-4e2f-a102-815df1443ce6 tempest-SnapshotMetadataTestJSON-881258191 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b50f4648-45e5-4e80-a587-d116bad564c9.26c35e5a-3bc9-470c-bca8-b51efdb37d89 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:41:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-40e7cb12-ab78-4e2f-a102-815df1443ce6 tempest-SnapshotMetadataTestJSON-881258191 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b50f4648-45e5-4e80-a587-d116bad564c9.26c35e5a-3bc9-470c-bca8-b51efdb37d89" returned: 0 in 0.135s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:41:01 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-40e7cb12-ab78-4e2f-a102-815df1443ce6 tempest-SnapshotMetadataTestJSON-881258191 None] Lock "cinder-quobyte-26c35e5a-3bc9-470c-bca8-b51efdb37d89" released by "_delete_snapshot" :: held 2.862s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:41:01 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-40e7cb12-ab78-4e2f-a102-815df1443ce6 tempest-SnapshotMetadataTestJSON-881258191 None] Lock "cinder-quobyte-b50f4648-45e5-4e80-a587-d116bad564c9" released by "delete_snapshot" :: held 2.912s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:41:02 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-40e7cb12-ab78-4e2f-a102-815df1443ce6 tempest-SnapshotMetadataTestJSON-881258191 None] Created reservations ['64c0f074-9ff7-4d25-adb8-b4ca0e052495', 'c92b210f-0a3d-41e6-86b1-1165fc6c5500', 'c905e87b-1401-4f01-b8ee-efb3a2a41412', 'b52693df-8f13-4b22-94d5-a714b8f61b7f'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:41:02 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-40e7cb12-ab78-4e2f-a102-815df1443ce6 tempest-SnapshotMetadataTestJSON-881258191 None] Delete snapshot completed successfully.
Sep 18 11:41:02 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-40e7cb12-ab78-4e2f-a102-815df1443ce6 tempest-SnapshotMetadataTestJSON-881258191 None] Lock "cinder-26c35e5a-3bc9-470c-bca8-b51efdb37d89-delete_snapshot" released by "delete_snapshot" :: held 3.642s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:41:03 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4e1e3567-c58c-413d-b817-0a34aaf22ffb tempest-SnapshotMetadataTestJSON-881258191 None] Acquiring lock "cinder-b50f4648-45e5-4e80-a587-d116bad564c9-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:41:03 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4e1e3567-c58c-413d-b817-0a34aaf22ffb tempest-SnapshotMetadataTestJSON-881258191 None] Lock "cinder-b50f4648-45e5-4e80-a587-d116bad564c9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:41:03 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-4e1e3567-c58c-413d-b817-0a34aaf22ffb tempest-SnapshotMetadataTestJSON-881258191 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:41:03 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4e1e3567-c58c-413d-b817-0a34aaf22ffb tempest-SnapshotMetadataTestJSON-881258191 None] Acquiring lock "cinder-quobyte-b50f4648-45e5-4e80-a587-d116bad564c9" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:41:03 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4e1e3567-c58c-413d-b817-0a34aaf22ffb tempest-SnapshotMetadataTestJSON-881258191 None] Lock "cinder-quobyte-b50f4648-45e5-4e80-a587-d116bad564c9" acquired by "delete_volume" :: waited 0.022s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:41:03 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e9d51a-2135-4530-ad14-4e7155d129fd]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:41:03 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4e1e3567-c58c-413d-b817-0a34aaf22ffb tempest-SnapshotMetadataTestJSON-881258191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b50f4648-45e5-4e80-a587-d116bad564c9 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:41:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4e1e3567-c58c-413d-b817-0a34aaf22ffb tempest-SnapshotMetadataTestJSON-881258191 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b50f4648-45e5-4e80-a587-d116bad564c9" returned: 0 in 0.515s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:41:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4e1e3567-c58c-413d-b817-0a34aaf22ffb tempest-SnapshotMetadataTestJSON-881258191 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b50f4648-45e5-4e80-a587-d116bad564c9 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:41:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4e1e3567-c58c-413d-b817-0a34aaf22ffb tempest-SnapshotMetadataTestJSON-881258191 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b50f4648-45e5-4e80-a587-d116bad564c9" returned: 0 in 0.142s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:41:04 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4e1e3567-c58c-413d-b817-0a34aaf22ffb tempest-SnapshotMetadataTestJSON-881258191 None] Lock "cinder-quobyte-b50f4648-45e5-4e80-a587-d116bad564c9" released by "delete_volume" :: held 0.872s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:41:04 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-4e1e3567-c58c-413d-b817-0a34aaf22ffb tempest-SnapshotMetadataTestJSON-881258191 None] Created reservations ['4cf12952-f5bc-4f4a-8ec2-2afe81f0a0de', 'e7feceed-15f7-4b64-a84d-ca0ccbfbac3f', '2bbdf427-e443-4e3c-b654-19e9ebffda99', 'd634743b-aadc-4d43-91c9-46bffa3195cc'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:41:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4e1e3567-c58c-413d-b817-0a34aaf22ffb tempest-SnapshotMetadataTestJSON-881258191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:41:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4e1e3567-c58c-413d-b817-0a34aaf22ffb tempest-SnapshotMetadataTestJSON-881258191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:41:04 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-4e1e3567-c58c-413d-b817-0a34aaf22ffb tempest-SnapshotMetadataTestJSON-881258191 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:41:04 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-4e1e3567-c58c-413d-b817-0a34aaf22ffb tempest-SnapshotMetadataTestJSON-881258191 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:41:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4e1e3567-c58c-413d-b817-0a34aaf22ffb tempest-SnapshotMetadataTestJSON-881258191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:41:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4e1e3567-c58c-413d-b817-0a34aaf22ffb tempest-SnapshotMetadataTestJSON-881258191 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:41:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4e1e3567-c58c-413d-b817-0a34aaf22ffb tempest-SnapshotMetadataTestJSON-881258191 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.161s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:41:05 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-4e1e3567-c58c-413d-b817-0a34aaf22ffb tempest-SnapshotMetadataTestJSON-881258191 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:41:05 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-4e1e3567-c58c-413d-b817-0a34aaf22ffb tempest-SnapshotMetadataTestJSON-881258191 None] Deleted volume successfully.
Sep 18 11:41:05 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4e1e3567-c58c-413d-b817-0a34aaf22ffb tempest-SnapshotMetadataTestJSON-881258191 None] Lock "cinder-b50f4648-45e5-4e80-a587-d116bad564c9-delete_volume" released by "delete_volume" :: held 2.039s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:41:13 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 11:41:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:41:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:41:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:41:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:41:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:41:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:41:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.282s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:41:14 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:41:14 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=33,cinder:UPDATE=45,cinder:DELETE=4,cinder:INSERT=4 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:41:15 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:UPDATE=52,cinder:SELECT=43,cinder:INSERT=29,cinder:DELETE=5 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:41:19 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-06f8a73a-7e56-4ec1-a758-b0a159640ee4 tempest-VolumesListTestJSON-566809955 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:41:19 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-06f8a73a-7e56-4ec1-a758-b0a159640ee4 tempest-VolumesListTestJSON-566809955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:41:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-06f8a73a-7e56-4ec1-a758-b0a159640ee4 tempest-VolumesListTestJSON-566809955 None] Flow 'volume_create_manager' (1dbd1dd5-5559-4911-aee3-529a6540182a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:41:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-06f8a73a-7e56-4ec1-a758-b0a159640ee4 tempest-VolumesListTestJSON-566809955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07c7618d-feb3-4577-80b8-cf303f358ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:41:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-06f8a73a-7e56-4ec1-a758-b0a159640ee4 tempest-VolumesListTestJSON-566809955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07c7618d-feb3-4577-80b8-cf303f358ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-719094916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4db8ef26-45a6-41ec-bea4-acb5c379421f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2aeb116f7e5343e78bc6567fb811dc98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:41:19Z,use_quota=True,user_id='823db8a801724347aab310a2e7b128b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:41:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-06f8a73a-7e56-4ec1-a758-b0a159640ee4 tempest-VolumesListTestJSON-566809955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ded6e527-b116-412c-9c4f-827ce3e6a5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:41:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-06f8a73a-7e56-4ec1-a758-b0a159640ee4 tempest-VolumesListTestJSON-566809955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ded6e527-b116-412c-9c4f-827ce3e6a5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:41:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-06f8a73a-7e56-4ec1-a758-b0a159640ee4 tempest-VolumesListTestJSON-566809955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (093e9a1a-6b73-48ee-8130-7d2e72c58088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:41:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-06f8a73a-7e56-4ec1-a758-b0a159640ee4 tempest-VolumesListTestJSON-566809955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (093e9a1a-6b73-48ee-8130-7d2e72c58088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4db8ef26-45a6-41ec-bea4-acb5c379421f', 'volume_name': 'volume-4db8ef26-45a6-41ec-bea4-acb5c379421f', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:41:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-06f8a73a-7e56-4ec1-a758-b0a159640ee4 tempest-VolumesListTestJSON-566809955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e49148bd-ff22-4490-a9d4-704510d1941c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:41:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-06f8a73a-7e56-4ec1-a758-b0a159640ee4 tempest-VolumesListTestJSON-566809955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e49148bd-ff22-4490-a9d4-704510d1941c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:41:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-06f8a73a-7e56-4ec1-a758-b0a159640ee4 tempest-VolumesListTestJSON-566809955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (731fdd2a-580c-409e-a680-d87e30d694f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:41:19 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-06f8a73a-7e56-4ec1-a758-b0a159640ee4 tempest-VolumesListTestJSON-566809955 None] Volume 4db8ef26-45a6-41ec-bea4-acb5c379421f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4db8ef26-45a6-41ec-bea4-acb5c379421f', 'volume_size': 1}
Sep 18 11:41:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-06f8a73a-7e56-4ec1-a758-b0a159640ee4 tempest-VolumesListTestJSON-566809955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:41:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-06f8a73a-7e56-4ec1-a758-b0a159640ee4 tempest-VolumesListTestJSON-566809955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:41:19 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-06f8a73a-7e56-4ec1-a758-b0a159640ee4 tempest-VolumesListTestJSON-566809955 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-719094916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4db8ef26-45a6-41ec-bea4-acb5c379421f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2aeb116f7e5343e78bc6567fb811dc98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:41:19Z,use_quota=True,user_id='823db8a801724347aab310a2e7b128b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:41:19 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-06f8a73a-7e56-4ec1-a758-b0a159640ee4 tempest-VolumesListTestJSON-566809955 None] Creating volume 4db8ef26-45a6-41ec-bea4-acb5c379421f {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:41:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-06f8a73a-7e56-4ec1-a758-b0a159640ee4 tempest-VolumesListTestJSON-566809955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:41:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-06f8a73a-7e56-4ec1-a758-b0a159640ee4 tempest-VolumesListTestJSON-566809955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:41:19 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-06f8a73a-7e56-4ec1-a758-b0a159640ee4 tempest-VolumesListTestJSON-566809955 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:41:19 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-06f8a73a-7e56-4ec1-a758-b0a159640ee4 tempest-VolumesListTestJSON-566809955 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:41:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-06f8a73a-7e56-4ec1-a758-b0a159640ee4 tempest-VolumesListTestJSON-566809955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:41:19 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-06f8a73a-7e56-4ec1-a758-b0a159640ee4 tempest-VolumesListTestJSON-566809955 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:41:19 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-06f8a73a-7e56-4ec1-a758-b0a159640ee4 tempest-VolumesListTestJSON-566809955 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:41:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-06f8a73a-7e56-4ec1-a758-b0a159640ee4 tempest-VolumesListTestJSON-566809955 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4db8ef26-45a6-41ec-bea4-acb5c379421f 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:41:19 devstack quobyte-client[83193]: System call of process 90895 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:41:19 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=34, name=volume-4db8ef26-45a6-41ec-bea4-acb5c379421f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:41:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-06f8a73a-7e56-4ec1-a758-b0a159640ee4 tempest-VolumesListTestJSON-566809955 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4db8ef26-45a6-41ec-bea4-acb5c379421f 1073741824" returned: 0 in 0.432s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:41:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-06f8a73a-7e56-4ec1-a758-b0a159640ee4 tempest-VolumesListTestJSON-566809955 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4db8ef26-45a6-41ec-bea4-acb5c379421f {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:41:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-06f8a73a-7e56-4ec1-a758-b0a159640ee4 tempest-VolumesListTestJSON-566809955 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4db8ef26-45a6-41ec-bea4-acb5c379421f" returned: 0 in 0.170s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:41:19 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-06f8a73a-7e56-4ec1-a758-b0a159640ee4 tempest-VolumesListTestJSON-566809955 None] <== create_volume: return (680ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:41:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-06f8a73a-7e56-4ec1-a758-b0a159640ee4 tempest-VolumesListTestJSON-566809955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:41:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-06f8a73a-7e56-4ec1-a758-b0a159640ee4 tempest-VolumesListTestJSON-566809955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (731fdd2a-580c-409e-a680-d87e30d694f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4db8ef26-45a6-41ec-bea4-acb5c379421f', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:41:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-06f8a73a-7e56-4ec1-a758-b0a159640ee4 tempest-VolumesListTestJSON-566809955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de85d611-478e-494c-8386-66bab5af3652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:41:20 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-06f8a73a-7e56-4ec1-a758-b0a159640ee4 tempest-VolumesListTestJSON-566809955 None] Volume volume-4db8ef26-45a6-41ec-bea4-acb5c379421f (4db8ef26-45a6-41ec-bea4-acb5c379421f): created successfully
Sep 18 11:41:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-06f8a73a-7e56-4ec1-a758-b0a159640ee4 tempest-VolumesListTestJSON-566809955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de85d611-478e-494c-8386-66bab5af3652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:41:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-06f8a73a-7e56-4ec1-a758-b0a159640ee4 tempest-VolumesListTestJSON-566809955 None] Flow 'volume_create_manager' (1dbd1dd5-5559-4911-aee3-529a6540182a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:41:20 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-06f8a73a-7e56-4ec1-a758-b0a159640ee4 tempest-VolumesListTestJSON-566809955 None] Created volume successfully.
Sep 18 11:41:21 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-5da91704-c855-4f86-bc37-08c7d426590d tempest-VolumesListTestJSON-566809955 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:41:21 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-5da91704-c855-4f86-bc37-08c7d426590d tempest-VolumesListTestJSON-566809955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:41:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-5da91704-c855-4f86-bc37-08c7d426590d tempest-VolumesListTestJSON-566809955 None] Flow 'volume_create_manager' (316e91f2-837f-418f-9c81-71085f64e30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:41:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-5da91704-c855-4f86-bc37-08c7d426590d tempest-VolumesListTestJSON-566809955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45e364e1-9055-4654-8908-514084b4a60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:41:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-5da91704-c855-4f86-bc37-08c7d426590d tempest-VolumesListTestJSON-566809955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45e364e1-9055-4654-8908-514084b4a60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-84963163',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28d276fe-d587-4826-b366-78764b621d28,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2aeb116f7e5343e78bc6567fb811dc98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:41:22Z,use_quota=True,user_id='823db8a801724347aab310a2e7b128b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:41:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-5da91704-c855-4f86-bc37-08c7d426590d tempest-VolumesListTestJSON-566809955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f03ea776-361e-4b79-a55e-775c240bd298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:41:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-5da91704-c855-4f86-bc37-08c7d426590d tempest-VolumesListTestJSON-566809955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f03ea776-361e-4b79-a55e-775c240bd298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:41:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-5da91704-c855-4f86-bc37-08c7d426590d tempest-VolumesListTestJSON-566809955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0a80182-9de0-458f-a8d3-c5221f010d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:41:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-5da91704-c855-4f86-bc37-08c7d426590d tempest-VolumesListTestJSON-566809955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0a80182-9de0-458f-a8d3-c5221f010d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28d276fe-d587-4826-b366-78764b621d28', 'volume_name': 'volume-28d276fe-d587-4826-b366-78764b621d28', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:41:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-5da91704-c855-4f86-bc37-08c7d426590d tempest-VolumesListTestJSON-566809955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5880571e-4381-44ed-94a6-4f6159a485d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:41:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-5da91704-c855-4f86-bc37-08c7d426590d tempest-VolumesListTestJSON-566809955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5880571e-4381-44ed-94a6-4f6159a485d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:41:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-5da91704-c855-4f86-bc37-08c7d426590d tempest-VolumesListTestJSON-566809955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc8c0caf-06f1-487b-b428-8cdd132c2acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:41:21 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-5da91704-c855-4f86-bc37-08c7d426590d tempest-VolumesListTestJSON-566809955 None] Volume 28d276fe-d587-4826-b366-78764b621d28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28d276fe-d587-4826-b366-78764b621d28', 'volume_size': 1}
Sep 18 11:41:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-5da91704-c855-4f86-bc37-08c7d426590d tempest-VolumesListTestJSON-566809955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:41:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-5da91704-c855-4f86-bc37-08c7d426590d tempest-VolumesListTestJSON-566809955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:41:21 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-5da91704-c855-4f86-bc37-08c7d426590d tempest-VolumesListTestJSON-566809955 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-84963163',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28d276fe-d587-4826-b366-78764b621d28,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2aeb116f7e5343e78bc6567fb811dc98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:41:22Z,use_quota=True,user_id='823db8a801724347aab310a2e7b128b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:41:21 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-5da91704-c855-4f86-bc37-08c7d426590d tempest-VolumesListTestJSON-566809955 None] Creating volume 28d276fe-d587-4826-b366-78764b621d28 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:41:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-5da91704-c855-4f86-bc37-08c7d426590d tempest-VolumesListTestJSON-566809955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:41:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-5da91704-c855-4f86-bc37-08c7d426590d tempest-VolumesListTestJSON-566809955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:41:21 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-5da91704-c855-4f86-bc37-08c7d426590d tempest-VolumesListTestJSON-566809955 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:41:21 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-5da91704-c855-4f86-bc37-08c7d426590d tempest-VolumesListTestJSON-566809955 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:41:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-5da91704-c855-4f86-bc37-08c7d426590d tempest-VolumesListTestJSON-566809955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:41:21 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-5da91704-c855-4f86-bc37-08c7d426590d tempest-VolumesListTestJSON-566809955 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:41:21 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-5da91704-c855-4f86-bc37-08c7d426590d tempest-VolumesListTestJSON-566809955 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:41:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5da91704-c855-4f86-bc37-08c7d426590d tempest-VolumesListTestJSON-566809955 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-28d276fe-d587-4826-b366-78764b621d28 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:41:22 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=35, name=volume-28d276fe-d587-4826-b366-78764b621d28, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:41:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5da91704-c855-4f86-bc37-08c7d426590d tempest-VolumesListTestJSON-566809955 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-28d276fe-d587-4826-b366-78764b621d28 1073741824" returned: 0 in 0.389s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:41:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5da91704-c855-4f86-bc37-08c7d426590d tempest-VolumesListTestJSON-566809955 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-28d276fe-d587-4826-b366-78764b621d28 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:41:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5da91704-c855-4f86-bc37-08c7d426590d tempest-VolumesListTestJSON-566809955 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-28d276fe-d587-4826-b366-78764b621d28" returned: 0 in 0.133s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:41:22 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-5da91704-c855-4f86-bc37-08c7d426590d tempest-VolumesListTestJSON-566809955 None] <== create_volume: return (593ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:41:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-5da91704-c855-4f86-bc37-08c7d426590d tempest-VolumesListTestJSON-566809955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.605s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:41:22 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-5da91704-c855-4f86-bc37-08c7d426590d tempest-VolumesListTestJSON-566809955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc8c0caf-06f1-487b-b428-8cdd132c2acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28d276fe-d587-4826-b366-78764b621d28', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:41:22 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-5da91704-c855-4f86-bc37-08c7d426590d tempest-VolumesListTestJSON-566809955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fe69467-fbf3-4c8e-8ac8-f2eb3bcb6555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:41:22 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-5da91704-c855-4f86-bc37-08c7d426590d tempest-VolumesListTestJSON-566809955 None] Volume volume-28d276fe-d587-4826-b366-78764b621d28 (28d276fe-d587-4826-b366-78764b621d28): created successfully
Sep 18 11:41:22 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-5da91704-c855-4f86-bc37-08c7d426590d tempest-VolumesListTestJSON-566809955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fe69467-fbf3-4c8e-8ac8-f2eb3bcb6555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:41:22 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-5da91704-c855-4f86-bc37-08c7d426590d tempest-VolumesListTestJSON-566809955 None] Flow 'volume_create_manager' (316e91f2-837f-418f-9c81-71085f64e30b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:41:23 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-5da91704-c855-4f86-bc37-08c7d426590d tempest-VolumesListTestJSON-566809955 None] Created volume successfully.
Sep 18 11:41:24 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-0218c4e4-6d7b-4717-9424-2d2d387f7d71 tempest-VolumesListTestJSON-566809955 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:41:24 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-0218c4e4-6d7b-4717-9424-2d2d387f7d71 tempest-VolumesListTestJSON-566809955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:41:24 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0218c4e4-6d7b-4717-9424-2d2d387f7d71 tempest-VolumesListTestJSON-566809955 None] Flow 'volume_create_manager' (3a5db4ee-2c97-4c64-872f-4bf0e66e9f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:41:24 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0218c4e4-6d7b-4717-9424-2d2d387f7d71 tempest-VolumesListTestJSON-566809955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8097d2b-8bc0-48ac-b350-c1b81114db07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:41:24 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0218c4e4-6d7b-4717-9424-2d2d387f7d71 tempest-VolumesListTestJSON-566809955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8097d2b-8bc0-48ac-b350-c1b81114db07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-458771536',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97be2569-f133-4d4e-82ce-457d248ec48f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2aeb116f7e5343e78bc6567fb811dc98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:41:24Z,use_quota=True,user_id='823db8a801724347aab310a2e7b128b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:41:24 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0218c4e4-6d7b-4717-9424-2d2d387f7d71 tempest-VolumesListTestJSON-566809955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f56b46e8-439c-4a99-9828-ac2ceb9e67f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:41:24 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0218c4e4-6d7b-4717-9424-2d2d387f7d71 tempest-VolumesListTestJSON-566809955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f56b46e8-439c-4a99-9828-ac2ceb9e67f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:41:24 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0218c4e4-6d7b-4717-9424-2d2d387f7d71 tempest-VolumesListTestJSON-566809955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90b1d0e1-8cb1-4797-91ff-3ba4f2b14121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:41:24 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0218c4e4-6d7b-4717-9424-2d2d387f7d71 tempest-VolumesListTestJSON-566809955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90b1d0e1-8cb1-4797-91ff-3ba4f2b14121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97be2569-f133-4d4e-82ce-457d248ec48f', 'volume_name': 'volume-97be2569-f133-4d4e-82ce-457d248ec48f', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:41:24 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0218c4e4-6d7b-4717-9424-2d2d387f7d71 tempest-VolumesListTestJSON-566809955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35f9ea88-29b9-441c-94d1-5eb230d97b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:41:24 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0218c4e4-6d7b-4717-9424-2d2d387f7d71 tempest-VolumesListTestJSON-566809955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35f9ea88-29b9-441c-94d1-5eb230d97b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:41:24 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0218c4e4-6d7b-4717-9424-2d2d387f7d71 tempest-VolumesListTestJSON-566809955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c60f52d-ed4c-40b9-9745-260abb88822c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:41:24 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-0218c4e4-6d7b-4717-9424-2d2d387f7d71 tempest-VolumesListTestJSON-566809955 None] Volume 97be2569-f133-4d4e-82ce-457d248ec48f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97be2569-f133-4d4e-82ce-457d248ec48f', 'volume_size': 1}
Sep 18 11:41:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0218c4e4-6d7b-4717-9424-2d2d387f7d71 tempest-VolumesListTestJSON-566809955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:41:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0218c4e4-6d7b-4717-9424-2d2d387f7d71 tempest-VolumesListTestJSON-566809955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:41:24 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-0218c4e4-6d7b-4717-9424-2d2d387f7d71 tempest-VolumesListTestJSON-566809955 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-458771536',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97be2569-f133-4d4e-82ce-457d248ec48f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2aeb116f7e5343e78bc6567fb811dc98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:41:24Z,use_quota=True,user_id='823db8a801724347aab310a2e7b128b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:41:24 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-0218c4e4-6d7b-4717-9424-2d2d387f7d71 tempest-VolumesListTestJSON-566809955 None] Creating volume 97be2569-f133-4d4e-82ce-457d248ec48f {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:41:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0218c4e4-6d7b-4717-9424-2d2d387f7d71 tempest-VolumesListTestJSON-566809955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:41:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0218c4e4-6d7b-4717-9424-2d2d387f7d71 tempest-VolumesListTestJSON-566809955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:41:24 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-0218c4e4-6d7b-4717-9424-2d2d387f7d71 tempest-VolumesListTestJSON-566809955 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:41:24 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-0218c4e4-6d7b-4717-9424-2d2d387f7d71 tempest-VolumesListTestJSON-566809955 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:41:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0218c4e4-6d7b-4717-9424-2d2d387f7d71 tempest-VolumesListTestJSON-566809955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:41:24 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-0218c4e4-6d7b-4717-9424-2d2d387f7d71 tempest-VolumesListTestJSON-566809955 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:41:24 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-0218c4e4-6d7b-4717-9424-2d2d387f7d71 tempest-VolumesListTestJSON-566809955 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:41:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0218c4e4-6d7b-4717-9424-2d2d387f7d71 tempest-VolumesListTestJSON-566809955 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-97be2569-f133-4d4e-82ce-457d248ec48f 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:41:24 devstack quobyte-client[83193]: System call of process 90936 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:41:24 devstack quobyte-client[83193]: System call of process 90936 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:41:24 devstack quobyte-client[83193]: System call of process 90936 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:41:24 devstack quobyte-client[83193]: System call of process 90936 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:41:24 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=36, name=volume-97be2569-f133-4d4e-82ce-457d248ec48f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:41:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0218c4e4-6d7b-4717-9424-2d2d387f7d71 tempest-VolumesListTestJSON-566809955 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-97be2569-f133-4d4e-82ce-457d248ec48f 1073741824" returned: 0 in 0.401s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:41:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0218c4e4-6d7b-4717-9424-2d2d387f7d71 tempest-VolumesListTestJSON-566809955 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-97be2569-f133-4d4e-82ce-457d248ec48f {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:41:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0218c4e4-6d7b-4717-9424-2d2d387f7d71 tempest-VolumesListTestJSON-566809955 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-97be2569-f133-4d4e-82ce-457d248ec48f" returned: 0 in 0.145s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:41:25 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-0218c4e4-6d7b-4717-9424-2d2d387f7d71 tempest-VolumesListTestJSON-566809955 None] <== create_volume: return (624ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:41:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0218c4e4-6d7b-4717-9424-2d2d387f7d71 tempest-VolumesListTestJSON-566809955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.650s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:41:25 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0218c4e4-6d7b-4717-9424-2d2d387f7d71 tempest-VolumesListTestJSON-566809955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c60f52d-ed4c-40b9-9745-260abb88822c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97be2569-f133-4d4e-82ce-457d248ec48f', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:41:25 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0218c4e4-6d7b-4717-9424-2d2d387f7d71 tempest-VolumesListTestJSON-566809955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1705f9e0-ba86-471c-91cd-2045a9556959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:41:25 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-0218c4e4-6d7b-4717-9424-2d2d387f7d71 tempest-VolumesListTestJSON-566809955 None] Volume volume-97be2569-f133-4d4e-82ce-457d248ec48f (97be2569-f133-4d4e-82ce-457d248ec48f): created successfully
Sep 18 11:41:25 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0218c4e4-6d7b-4717-9424-2d2d387f7d71 tempest-VolumesListTestJSON-566809955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1705f9e0-ba86-471c-91cd-2045a9556959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:41:25 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0218c4e4-6d7b-4717-9424-2d2d387f7d71 tempest-VolumesListTestJSON-566809955 None] Flow 'volume_create_manager' (3a5db4ee-2c97-4c64-872f-4bf0e66e9f51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:41:25 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-0218c4e4-6d7b-4717-9424-2d2d387f7d71 tempest-VolumesListTestJSON-566809955 None] Created volume successfully.
Sep 18 11:41:31 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ae0df52e-9ba8-465b-b734-d9a5965a89b3 tempest-VolumesListTestJSON-566809955 None] Acquiring lock "cinder-97be2569-f133-4d4e-82ce-457d248ec48f-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:41:31 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ae0df52e-9ba8-465b-b734-d9a5965a89b3 tempest-VolumesListTestJSON-566809955 None] Lock "cinder-97be2569-f133-4d4e-82ce-457d248ec48f-delete_volume" acquired by "delete_volume" :: waited 0.122s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:41:31 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-ae0df52e-9ba8-465b-b734-d9a5965a89b3 tempest-VolumesListTestJSON-566809955 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:41:31 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ae0df52e-9ba8-465b-b734-d9a5965a89b3 tempest-VolumesListTestJSON-566809955 None] Acquiring lock "cinder-quobyte-97be2569-f133-4d4e-82ce-457d248ec48f" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:41:31 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ae0df52e-9ba8-465b-b734-d9a5965a89b3 tempest-VolumesListTestJSON-566809955 None] Lock "cinder-quobyte-97be2569-f133-4d4e-82ce-457d248ec48f" acquired by "delete_volume" :: waited 0.017s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:41:31 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[288b169a-910c-4952-b8f1-68298de018e8]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:41:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ae0df52e-9ba8-465b-b734-d9a5965a89b3 tempest-VolumesListTestJSON-566809955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-97be2569-f133-4d4e-82ce-457d248ec48f {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:41:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ae0df52e-9ba8-465b-b734-d9a5965a89b3 tempest-VolumesListTestJSON-566809955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-97be2569-f133-4d4e-82ce-457d248ec48f" returned: 0 in 0.636s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:41:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ae0df52e-9ba8-465b-b734-d9a5965a89b3 tempest-VolumesListTestJSON-566809955 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-97be2569-f133-4d4e-82ce-457d248ec48f {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:41:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ae0df52e-9ba8-465b-b734-d9a5965a89b3 tempest-VolumesListTestJSON-566809955 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-97be2569-f133-4d4e-82ce-457d248ec48f" returned: 0 in 0.152s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:41:32 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ae0df52e-9ba8-465b-b734-d9a5965a89b3 tempest-VolumesListTestJSON-566809955 None] Lock "cinder-quobyte-97be2569-f133-4d4e-82ce-457d248ec48f" released by "delete_volume" :: held 1.037s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:41:32 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-ae0df52e-9ba8-465b-b734-d9a5965a89b3 tempest-VolumesListTestJSON-566809955 None] Created reservations ['41336eb9-884f-429a-b501-a493920d98b8', 'f7b86d33-750e-4713-aefe-0e2268031967', '98939d50-85e6-4573-894f-e08be3933fa9', '3c65df70-1cf9-4f20-8c1b-bf5ded3fed40'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:41:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ae0df52e-9ba8-465b-b734-d9a5965a89b3 tempest-VolumesListTestJSON-566809955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:41:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ae0df52e-9ba8-465b-b734-d9a5965a89b3 tempest-VolumesListTestJSON-566809955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:41:33 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-ae0df52e-9ba8-465b-b734-d9a5965a89b3 tempest-VolumesListTestJSON-566809955 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:41:33 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-ae0df52e-9ba8-465b-b734-d9a5965a89b3 tempest-VolumesListTestJSON-566809955 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:41:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ae0df52e-9ba8-465b-b734-d9a5965a89b3 tempest-VolumesListTestJSON-566809955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:41:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ae0df52e-9ba8-465b-b734-d9a5965a89b3 tempest-VolumesListTestJSON-566809955 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:41:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ae0df52e-9ba8-465b-b734-d9a5965a89b3 tempest-VolumesListTestJSON-566809955 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.195s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:41:33 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-ae0df52e-9ba8-465b-b734-d9a5965a89b3 tempest-VolumesListTestJSON-566809955 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:41:33 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-ae0df52e-9ba8-465b-b734-d9a5965a89b3 tempest-VolumesListTestJSON-566809955 None] Deleted volume successfully.
Sep 18 11:41:33 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-6c061c06-6593-4c34-93eb-cccc836b7705 req-e6f729f8-bd05-4b1b-9e0a-fc3266e8a524 tempest-AttachVolumeNegativeTest-652039892 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:41:33 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-316aab79-0efe-4c1d-b155-c939550d8d2f tempest-VolumesListTestJSON-566809955 None] Acquiring lock "cinder-28d276fe-d587-4826-b366-78764b621d28-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:41:34 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-6c061c06-6593-4c34-93eb-cccc836b7705 req-e6f729f8-bd05-4b1b-9e0a-fc3266e8a524 tempest-AttachVolumeNegativeTest-652039892 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:41:34 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-6c061c06-6593-4c34-93eb-cccc836b7705 req-e6f729f8-bd05-4b1b-9e0a-fc3266e8a524 tempest-AttachVolumeNegativeTest-652039892 None] Terminate volume connection completed successfully.
Sep 18 11:41:34 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-6c061c06-6593-4c34-93eb-cccc836b7705 req-e6f729f8-bd05-4b1b-9e0a-fc3266e8a524 tempest-AttachVolumeNegativeTest-652039892 None] Deleting attachment 67f18b6a-2d24-4c1f-a84d-3cd636d3f4fc. {{(pid=83176) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 11:41:34 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ae0df52e-9ba8-465b-b734-d9a5965a89b3 tempest-VolumesListTestJSON-566809955 None] Lock "cinder-97be2569-f133-4d4e-82ce-457d248ec48f-delete_volume" released by "delete_volume" :: held 2.873s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:41:34 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-316aab79-0efe-4c1d-b155-c939550d8d2f tempest-VolumesListTestJSON-566809955 None] Lock "cinder-28d276fe-d587-4826-b366-78764b621d28-delete_volume" acquired by "delete_volume" :: waited 0.156s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:41:34 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-316aab79-0efe-4c1d-b155-c939550d8d2f tempest-VolumesListTestJSON-566809955 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:41:34 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-316aab79-0efe-4c1d-b155-c939550d8d2f tempest-VolumesListTestJSON-566809955 None] Acquiring lock "cinder-quobyte-28d276fe-d587-4826-b366-78764b621d28" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:41:34 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-316aab79-0efe-4c1d-b155-c939550d8d2f tempest-VolumesListTestJSON-566809955 None] Lock "cinder-quobyte-28d276fe-d587-4826-b366-78764b621d28" acquired by "delete_volume" :: waited 0.035s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:41:34 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0cd1e1-0a10-4b74-804e-22764630bdf3]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:41:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-316aab79-0efe-4c1d-b155-c939550d8d2f tempest-VolumesListTestJSON-566809955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-28d276fe-d587-4826-b366-78764b621d28 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:41:34 devstack quobyte-client[83193]: System call of process 90974 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:41:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-316aab79-0efe-4c1d-b155-c939550d8d2f tempest-VolumesListTestJSON-566809955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-28d276fe-d587-4826-b366-78764b621d28" returned: 0 in 0.717s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:41:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-316aab79-0efe-4c1d-b155-c939550d8d2f tempest-VolumesListTestJSON-566809955 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-28d276fe-d587-4826-b366-78764b621d28 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:41:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-316aab79-0efe-4c1d-b155-c939550d8d2f tempest-VolumesListTestJSON-566809955 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-28d276fe-d587-4826-b366-78764b621d28" returned: 0 in 0.160s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:41:35 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-316aab79-0efe-4c1d-b155-c939550d8d2f tempest-VolumesListTestJSON-566809955 None] Lock "cinder-quobyte-28d276fe-d587-4826-b366-78764b621d28" released by "delete_volume" :: held 1.058s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:41:35 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-316aab79-0efe-4c1d-b155-c939550d8d2f tempest-VolumesListTestJSON-566809955 None] Created reservations ['8148f916-407d-45c7-926c-98856399592e', '4c8b12ea-4cb5-4e4a-932a-127f57e0e61a', 'b70d8a93-8a69-4ecc-aca4-be9ca256a1bb', '7cb429c4-8e64-45e4-9856-217c0edf411c'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:41:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-316aab79-0efe-4c1d-b155-c939550d8d2f tempest-VolumesListTestJSON-566809955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:41:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-316aab79-0efe-4c1d-b155-c939550d8d2f tempest-VolumesListTestJSON-566809955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.018s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:41:35 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-316aab79-0efe-4c1d-b155-c939550d8d2f tempest-VolumesListTestJSON-566809955 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:41:36 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-316aab79-0efe-4c1d-b155-c939550d8d2f tempest-VolumesListTestJSON-566809955 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:41:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-316aab79-0efe-4c1d-b155-c939550d8d2f tempest-VolumesListTestJSON-566809955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:41:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-316aab79-0efe-4c1d-b155-c939550d8d2f tempest-VolumesListTestJSON-566809955 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:41:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-316aab79-0efe-4c1d-b155-c939550d8d2f tempest-VolumesListTestJSON-566809955 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.123s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:41:36 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-316aab79-0efe-4c1d-b155-c939550d8d2f tempest-VolumesListTestJSON-566809955 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:41:36 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-316aab79-0efe-4c1d-b155-c939550d8d2f tempest-VolumesListTestJSON-566809955 None] Deleted volume successfully.
Sep 18 11:41:36 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0085223f-c9c8-4879-aa51-bea8eb25c53a tempest-VolumesListTestJSON-566809955 None] Acquiring lock "cinder-4db8ef26-45a6-41ec-bea4-acb5c379421f-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:41:36 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-316aab79-0efe-4c1d-b155-c939550d8d2f tempest-VolumesListTestJSON-566809955 None] Lock "cinder-28d276fe-d587-4826-b366-78764b621d28-delete_volume" released by "delete_volume" :: held 2.732s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:41:36 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0085223f-c9c8-4879-aa51-bea8eb25c53a tempest-VolumesListTestJSON-566809955 None] Lock "cinder-4db8ef26-45a6-41ec-bea4-acb5c379421f-delete_volume" acquired by "delete_volume" :: waited 0.125s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:41:37 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-0085223f-c9c8-4879-aa51-bea8eb25c53a tempest-VolumesListTestJSON-566809955 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:41:37 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0085223f-c9c8-4879-aa51-bea8eb25c53a tempest-VolumesListTestJSON-566809955 None] Acquiring lock "cinder-quobyte-4db8ef26-45a6-41ec-bea4-acb5c379421f" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:41:37 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0085223f-c9c8-4879-aa51-bea8eb25c53a tempest-VolumesListTestJSON-566809955 None] Lock "cinder-quobyte-4db8ef26-45a6-41ec-bea4-acb5c379421f" acquired by "delete_volume" :: waited 0.023s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:41:37 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdac9e1d-e4f2-4671-bd6e-65d87b0f46cb]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:41:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0085223f-c9c8-4879-aa51-bea8eb25c53a tempest-VolumesListTestJSON-566809955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4db8ef26-45a6-41ec-bea4-acb5c379421f {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:41:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0085223f-c9c8-4879-aa51-bea8eb25c53a tempest-VolumesListTestJSON-566809955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4db8ef26-45a6-41ec-bea4-acb5c379421f" returned: 0 in 1.726s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:41:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0085223f-c9c8-4879-aa51-bea8eb25c53a tempest-VolumesListTestJSON-566809955 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4db8ef26-45a6-41ec-bea4-acb5c379421f {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:41:39 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0085223f-c9c8-4879-aa51-bea8eb25c53a tempest-VolumesListTestJSON-566809955 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4db8ef26-45a6-41ec-bea4-acb5c379421f" returned: 0 in 0.238s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:41:39 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0085223f-c9c8-4879-aa51-bea8eb25c53a tempest-VolumesListTestJSON-566809955 None] Lock "cinder-quobyte-4db8ef26-45a6-41ec-bea4-acb5c379421f" released by "delete_volume" :: held 2.386s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:41:39 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-0085223f-c9c8-4879-aa51-bea8eb25c53a tempest-VolumesListTestJSON-566809955 None] Created reservations ['484d062e-2cb4-4b3d-8430-a9023b352781', '6062e51c-dc61-4a92-9e4b-fe6eb42e71b8', '7ee1e801-c618-420e-927a-aafa808a65e9', '70b5e63b-77bb-4248-a3bc-5ebadb564852'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:41:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0085223f-c9c8-4879-aa51-bea8eb25c53a tempest-VolumesListTestJSON-566809955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:41:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0085223f-c9c8-4879-aa51-bea8eb25c53a tempest-VolumesListTestJSON-566809955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:41:40 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-0085223f-c9c8-4879-aa51-bea8eb25c53a tempest-VolumesListTestJSON-566809955 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:41:40 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-0085223f-c9c8-4879-aa51-bea8eb25c53a tempest-VolumesListTestJSON-566809955 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:41:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0085223f-c9c8-4879-aa51-bea8eb25c53a tempest-VolumesListTestJSON-566809955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:41:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0085223f-c9c8-4879-aa51-bea8eb25c53a tempest-VolumesListTestJSON-566809955 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:41:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0085223f-c9c8-4879-aa51-bea8eb25c53a tempest-VolumesListTestJSON-566809955 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.219s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:41:40 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-0085223f-c9c8-4879-aa51-bea8eb25c53a tempest-VolumesListTestJSON-566809955 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:41:41 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-0085223f-c9c8-4879-aa51-bea8eb25c53a tempest-VolumesListTestJSON-566809955 None] Deleted volume successfully.
Sep 18 11:41:42 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0085223f-c9c8-4879-aa51-bea8eb25c53a tempest-VolumesListTestJSON-566809955 None] Lock "cinder-4db8ef26-45a6-41ec-bea4-acb5c379421f-delete_volume" released by "delete_volume" :: held 5.482s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:41:48 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-e8496803-3c78-4a81-b9b3-8342701c0404 tempest-VolumesNegativeTest-1159549234 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:41:48 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8496803-3c78-4a81-b9b3-8342701c0404 tempest-VolumesNegativeTest-1159549234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:41:48 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-e8496803-3c78-4a81-b9b3-8342701c0404 tempest-VolumesNegativeTest-1159549234 None] Flow 'volume_create_manager' (c6413797-cda2-4e86-acb6-ac4c559bce4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:41:49 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-e8496803-3c78-4a81-b9b3-8342701c0404 tempest-VolumesNegativeTest-1159549234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a0bc49-7229-4ff0-ae71-8d3126201cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:41:49 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-e8496803-3c78-4a81-b9b3-8342701c0404 tempest-VolumesNegativeTest-1159549234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a0bc49-7229-4ff0-ae71-8d3126201cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-494524982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f9b59e-ce26-4627-8b70-3be0e34d312a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b87777e5c3104e6890d346b5542961aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:41:48Z,use_quota=True,user_id='83fbed854e494fbea62ef5cd3f6ccc17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:41:49 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-e8496803-3c78-4a81-b9b3-8342701c0404 tempest-VolumesNegativeTest-1159549234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (195bb25f-d835-40c6-b0b0-561b689ea7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:41:49 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-e8496803-3c78-4a81-b9b3-8342701c0404 tempest-VolumesNegativeTest-1159549234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (195bb25f-d835-40c6-b0b0-561b689ea7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:41:49 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-e8496803-3c78-4a81-b9b3-8342701c0404 tempest-VolumesNegativeTest-1159549234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad3ac1e1-95d4-4c1a-8912-ec3ce1a9c6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:41:49 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-e8496803-3c78-4a81-b9b3-8342701c0404 tempest-VolumesNegativeTest-1159549234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad3ac1e1-95d4-4c1a-8912-ec3ce1a9c6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0f9b59e-ce26-4627-8b70-3be0e34d312a', 'volume_name': 'volume-f0f9b59e-ce26-4627-8b70-3be0e34d312a', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:41:49 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-e8496803-3c78-4a81-b9b3-8342701c0404 tempest-VolumesNegativeTest-1159549234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fde63d65-d12b-4ed0-b1cc-6f7cfa744e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:41:49 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-e8496803-3c78-4a81-b9b3-8342701c0404 tempest-VolumesNegativeTest-1159549234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fde63d65-d12b-4ed0-b1cc-6f7cfa744e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:41:49 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-e8496803-3c78-4a81-b9b3-8342701c0404 tempest-VolumesNegativeTest-1159549234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0940e0ee-e0b2-4d8a-9645-25008b4906ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:41:49 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-e8496803-3c78-4a81-b9b3-8342701c0404 tempest-VolumesNegativeTest-1159549234 None] Volume f0f9b59e-ce26-4627-8b70-3be0e34d312a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0f9b59e-ce26-4627-8b70-3be0e34d312a', 'volume_size': 1}
Sep 18 11:41:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-e8496803-3c78-4a81-b9b3-8342701c0404 tempest-VolumesNegativeTest-1159549234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:41:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-e8496803-3c78-4a81-b9b3-8342701c0404 tempest-VolumesNegativeTest-1159549234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:41:49 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-e8496803-3c78-4a81-b9b3-8342701c0404 tempest-VolumesNegativeTest-1159549234 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-494524982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f9b59e-ce26-4627-8b70-3be0e34d312a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b87777e5c3104e6890d346b5542961aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:41:48Z,use_quota=True,user_id='83fbed854e494fbea62ef5cd3f6ccc17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:41:49 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-e8496803-3c78-4a81-b9b3-8342701c0404 tempest-VolumesNegativeTest-1159549234 None] Creating volume f0f9b59e-ce26-4627-8b70-3be0e34d312a {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:41:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-e8496803-3c78-4a81-b9b3-8342701c0404 tempest-VolumesNegativeTest-1159549234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:41:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-e8496803-3c78-4a81-b9b3-8342701c0404 tempest-VolumesNegativeTest-1159549234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:41:49 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-e8496803-3c78-4a81-b9b3-8342701c0404 tempest-VolumesNegativeTest-1159549234 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:41:49 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-e8496803-3c78-4a81-b9b3-8342701c0404 tempest-VolumesNegativeTest-1159549234 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:41:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-e8496803-3c78-4a81-b9b3-8342701c0404 tempest-VolumesNegativeTest-1159549234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:41:49 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-e8496803-3c78-4a81-b9b3-8342701c0404 tempest-VolumesNegativeTest-1159549234 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:41:49 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-e8496803-3c78-4a81-b9b3-8342701c0404 tempest-VolumesNegativeTest-1159549234 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:41:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-e8496803-3c78-4a81-b9b3-8342701c0404 tempest-VolumesNegativeTest-1159549234 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f0f9b59e-ce26-4627-8b70-3be0e34d312a 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:41:49 devstack quobyte-client[83193]: System call of process 91127 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:41:49 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=37, name=volume-f0f9b59e-ce26-4627-8b70-3be0e34d312a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:41:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-e8496803-3c78-4a81-b9b3-8342701c0404 tempest-VolumesNegativeTest-1159549234 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f0f9b59e-ce26-4627-8b70-3be0e34d312a 1073741824" returned: 0 in 0.708s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:41:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-e8496803-3c78-4a81-b9b3-8342701c0404 tempest-VolumesNegativeTest-1159549234 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f0f9b59e-ce26-4627-8b70-3be0e34d312a {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:41:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-e8496803-3c78-4a81-b9b3-8342701c0404 tempest-VolumesNegativeTest-1159549234 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f0f9b59e-ce26-4627-8b70-3be0e34d312a" returned: 0 in 0.119s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:41:50 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-e8496803-3c78-4a81-b9b3-8342701c0404 tempest-VolumesNegativeTest-1159549234 None] <== create_volume: return (929ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:41:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-e8496803-3c78-4a81-b9b3-8342701c0404 tempest-VolumesNegativeTest-1159549234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:41:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-e8496803-3c78-4a81-b9b3-8342701c0404 tempest-VolumesNegativeTest-1159549234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0940e0ee-e0b2-4d8a-9645-25008b4906ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0f9b59e-ce26-4627-8b70-3be0e34d312a', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:41:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-e8496803-3c78-4a81-b9b3-8342701c0404 tempest-VolumesNegativeTest-1159549234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b0ed0f4-1af6-4f6e-b349-cd3645a8e236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:41:50 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-e8496803-3c78-4a81-b9b3-8342701c0404 tempest-VolumesNegativeTest-1159549234 None] Volume volume-f0f9b59e-ce26-4627-8b70-3be0e34d312a (f0f9b59e-ce26-4627-8b70-3be0e34d312a): created successfully
Sep 18 11:41:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-e8496803-3c78-4a81-b9b3-8342701c0404 tempest-VolumesNegativeTest-1159549234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b0ed0f4-1af6-4f6e-b349-cd3645a8e236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:41:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-e8496803-3c78-4a81-b9b3-8342701c0404 tempest-VolumesNegativeTest-1159549234 None] Flow 'volume_create_manager' (c6413797-cda2-4e86-acb6-ac4c559bce4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:41:50 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-e8496803-3c78-4a81-b9b3-8342701c0404 tempest-VolumesNegativeTest-1159549234 None] Created volume successfully.
Sep 18 11:42:00 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=15,cinder:UPDATE=30,cinder:DELETE=5,cinder:INSERT=7 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:42:00 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:UPDATE=34,cinder:SELECT=25,cinder:INSERT=5,cinder:DELETE=2 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:42:13 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 11:42:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:42:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:42:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:42:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:42:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:42:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:42:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.229s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:42:14 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:42:44 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:42:44 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:UPDATE=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:43:00 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-8856d92d-3e58-4992-b1ed-763446e2bd36 tempest-AttachVolumeShelveTestJSON-1847875693 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:43:00 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-8856d92d-3e58-4992-b1ed-763446e2bd36 tempest-AttachVolumeShelveTestJSON-1847875693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:43:00 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8856d92d-3e58-4992-b1ed-763446e2bd36 tempest-AttachVolumeShelveTestJSON-1847875693 None] Flow 'volume_create_manager' (9e6d302b-081c-447e-ad4f-fba1789e01a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:43:00 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8856d92d-3e58-4992-b1ed-763446e2bd36 tempest-AttachVolumeShelveTestJSON-1847875693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3cf2f8d-d605-422b-9c74-e0cc8cd78808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:00 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8856d92d-3e58-4992-b1ed-763446e2bd36 tempest-AttachVolumeShelveTestJSON-1847875693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3cf2f8d-d605-422b-9c74-e0cc8cd78808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1391948505',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1298a5e2-b3cd-4867-bc42-f76f9c8d14a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e15c46d6f5346c28943e8c739d07ec0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:43:00Z,use_quota=True,user_id='24dc058fb82f4189809476a527afe7e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:00 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8856d92d-3e58-4992-b1ed-763446e2bd36 tempest-AttachVolumeShelveTestJSON-1847875693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc48ab7-7530-4eef-93f3-ac66605e5bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:00 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8856d92d-3e58-4992-b1ed-763446e2bd36 tempest-AttachVolumeShelveTestJSON-1847875693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc48ab7-7530-4eef-93f3-ac66605e5bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:00 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8856d92d-3e58-4992-b1ed-763446e2bd36 tempest-AttachVolumeShelveTestJSON-1847875693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e9b17c2-c3f8-4b74-82dd-34104d0975dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:00 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8856d92d-3e58-4992-b1ed-763446e2bd36 tempest-AttachVolumeShelveTestJSON-1847875693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e9b17c2-c3f8-4b74-82dd-34104d0975dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1298a5e2-b3cd-4867-bc42-f76f9c8d14a1', 'volume_name': 'volume-1298a5e2-b3cd-4867-bc42-f76f9c8d14a1', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:00 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8856d92d-3e58-4992-b1ed-763446e2bd36 tempest-AttachVolumeShelveTestJSON-1847875693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea8720a-78e2-469b-91c2-708c6a350093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:00 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8856d92d-3e58-4992-b1ed-763446e2bd36 tempest-AttachVolumeShelveTestJSON-1847875693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea8720a-78e2-469b-91c2-708c6a350093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:00 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8856d92d-3e58-4992-b1ed-763446e2bd36 tempest-AttachVolumeShelveTestJSON-1847875693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e041b37-6923-4834-b47e-75e9ef79f758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:00 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-8856d92d-3e58-4992-b1ed-763446e2bd36 tempest-AttachVolumeShelveTestJSON-1847875693 None] Volume 1298a5e2-b3cd-4867-bc42-f76f9c8d14a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1298a5e2-b3cd-4867-bc42-f76f9c8d14a1', 'volume_size': 1}
Sep 18 11:43:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-8856d92d-3e58-4992-b1ed-763446e2bd36 tempest-AttachVolumeShelveTestJSON-1847875693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:43:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-8856d92d-3e58-4992-b1ed-763446e2bd36 tempest-AttachVolumeShelveTestJSON-1847875693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:43:00 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-8856d92d-3e58-4992-b1ed-763446e2bd36 tempest-AttachVolumeShelveTestJSON-1847875693 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1391948505',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1298a5e2-b3cd-4867-bc42-f76f9c8d14a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e15c46d6f5346c28943e8c739d07ec0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:43:00Z,use_quota=True,user_id='24dc058fb82f4189809476a527afe7e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:43:00 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-8856d92d-3e58-4992-b1ed-763446e2bd36 tempest-AttachVolumeShelveTestJSON-1847875693 None] Creating volume 1298a5e2-b3cd-4867-bc42-f76f9c8d14a1 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:43:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-8856d92d-3e58-4992-b1ed-763446e2bd36 tempest-AttachVolumeShelveTestJSON-1847875693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:43:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-8856d92d-3e58-4992-b1ed-763446e2bd36 tempest-AttachVolumeShelveTestJSON-1847875693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:43:00 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-8856d92d-3e58-4992-b1ed-763446e2bd36 tempest-AttachVolumeShelveTestJSON-1847875693 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:43:00 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-8856d92d-3e58-4992-b1ed-763446e2bd36 tempest-AttachVolumeShelveTestJSON-1847875693 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:43:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-8856d92d-3e58-4992-b1ed-763446e2bd36 tempest-AttachVolumeShelveTestJSON-1847875693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:43:00 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-8856d92d-3e58-4992-b1ed-763446e2bd36 tempest-AttachVolumeShelveTestJSON-1847875693 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:43:00 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-8856d92d-3e58-4992-b1ed-763446e2bd36 tempest-AttachVolumeShelveTestJSON-1847875693 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:43:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8856d92d-3e58-4992-b1ed-763446e2bd36 tempest-AttachVolumeShelveTestJSON-1847875693 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1298a5e2-b3cd-4867-bc42-f76f9c8d14a1 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:00 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=38, name=volume-1298a5e2-b3cd-4867-bc42-f76f9c8d14a1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:43:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8856d92d-3e58-4992-b1ed-763446e2bd36 tempest-AttachVolumeShelveTestJSON-1847875693 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1298a5e2-b3cd-4867-bc42-f76f9c8d14a1 1073741824" returned: 0 in 1.095s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8856d92d-3e58-4992-b1ed-763446e2bd36 tempest-AttachVolumeShelveTestJSON-1847875693 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1298a5e2-b3cd-4867-bc42-f76f9c8d14a1 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8856d92d-3e58-4992-b1ed-763446e2bd36 tempest-AttachVolumeShelveTestJSON-1847875693 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1298a5e2-b3cd-4867-bc42-f76f9c8d14a1" returned: 0 in 0.421s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:02 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-8856d92d-3e58-4992-b1ed-763446e2bd36 tempest-AttachVolumeShelveTestJSON-1847875693 None] <== create_volume: return (1718ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:43:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-8856d92d-3e58-4992-b1ed-763446e2bd36 tempest-AttachVolumeShelveTestJSON-1847875693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.741s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:43:02 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8856d92d-3e58-4992-b1ed-763446e2bd36 tempest-AttachVolumeShelveTestJSON-1847875693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e041b37-6923-4834-b47e-75e9ef79f758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1298a5e2-b3cd-4867-bc42-f76f9c8d14a1', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:02 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8856d92d-3e58-4992-b1ed-763446e2bd36 tempest-AttachVolumeShelveTestJSON-1847875693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae342a45-d9fc-4915-b00d-7fca6b50a4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:02 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-8856d92d-3e58-4992-b1ed-763446e2bd36 tempest-AttachVolumeShelveTestJSON-1847875693 None] Volume volume-1298a5e2-b3cd-4867-bc42-f76f9c8d14a1 (1298a5e2-b3cd-4867-bc42-f76f9c8d14a1): created successfully
Sep 18 11:43:02 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8856d92d-3e58-4992-b1ed-763446e2bd36 tempest-AttachVolumeShelveTestJSON-1847875693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae342a45-d9fc-4915-b00d-7fca6b50a4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:02 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8856d92d-3e58-4992-b1ed-763446e2bd36 tempest-AttachVolumeShelveTestJSON-1847875693 None] Flow 'volume_create_manager' (9e6d302b-081c-447e-ad4f-fba1789e01a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:43:02 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-8856d92d-3e58-4992-b1ed-763446e2bd36 tempest-AttachVolumeShelveTestJSON-1847875693 None] Created volume successfully.
Sep 18 11:43:04 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-d288853f-9e0b-4a75-962e-95c313bcf56d tempest-VolumesNegativeTest-1159549234 None] Acquiring lock "cinder-f0f9b59e-ce26-4627-8b70-3be0e34d312a-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:43:04 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-d288853f-9e0b-4a75-962e-95c313bcf56d tempest-VolumesNegativeTest-1159549234 None] Lock "cinder-f0f9b59e-ce26-4627-8b70-3be0e34d312a-delete_volume" acquired by "delete_volume" :: waited 0.129s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:43:04 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-d288853f-9e0b-4a75-962e-95c313bcf56d tempest-VolumesNegativeTest-1159549234 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:43:04 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-d288853f-9e0b-4a75-962e-95c313bcf56d tempest-VolumesNegativeTest-1159549234 None] Acquiring lock "cinder-quobyte-f0f9b59e-ce26-4627-8b70-3be0e34d312a" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:43:04 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-d288853f-9e0b-4a75-962e-95c313bcf56d tempest-VolumesNegativeTest-1159549234 None] Lock "cinder-quobyte-f0f9b59e-ce26-4627-8b70-3be0e34d312a" acquired by "delete_volume" :: waited 0.038s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:43:04 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2fd914-b3dc-4071-b636-cf0aedd8d93e]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:43:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d288853f-9e0b-4a75-962e-95c313bcf56d tempest-VolumesNegativeTest-1159549234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f0f9b59e-ce26-4627-8b70-3be0e34d312a {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:06 devstack quobyte-client[83193]: System call of process 91542 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:43:06 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d288853f-9e0b-4a75-962e-95c313bcf56d tempest-VolumesNegativeTest-1159549234 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f0f9b59e-ce26-4627-8b70-3be0e34d312a" returned: 0 in 1.258s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:06 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d288853f-9e0b-4a75-962e-95c313bcf56d tempest-VolumesNegativeTest-1159549234 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f0f9b59e-ce26-4627-8b70-3be0e34d312a {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:06 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d288853f-9e0b-4a75-962e-95c313bcf56d tempest-VolumesNegativeTest-1159549234 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f0f9b59e-ce26-4627-8b70-3be0e34d312a" returned: 0 in 0.312s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:07 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-d288853f-9e0b-4a75-962e-95c313bcf56d tempest-VolumesNegativeTest-1159549234 None] Lock "cinder-quobyte-f0f9b59e-ce26-4627-8b70-3be0e34d312a" released by "delete_volume" :: held 2.298s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:43:07 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-d288853f-9e0b-4a75-962e-95c313bcf56d tempest-VolumesNegativeTest-1159549234 None] Created reservations ['d69a9c41-26b0-4751-9c4a-9964cc3948df', 'e8487f35-0789-4ee9-8635-e237476ba22d', '060c85bc-6786-4717-b1e3-09d2ce932d00', '64a78e79-55d2-44bc-bb59-5bc70e72f312'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:43:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d288853f-9e0b-4a75-962e-95c313bcf56d tempest-VolumesNegativeTest-1159549234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:43:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d288853f-9e0b-4a75-962e-95c313bcf56d tempest-VolumesNegativeTest-1159549234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:43:08 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-d288853f-9e0b-4a75-962e-95c313bcf56d tempest-VolumesNegativeTest-1159549234 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:43:08 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-d288853f-9e0b-4a75-962e-95c313bcf56d tempest-VolumesNegativeTest-1159549234 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:43:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d288853f-9e0b-4a75-962e-95c313bcf56d tempest-VolumesNegativeTest-1159549234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:43:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d288853f-9e0b-4a75-962e-95c313bcf56d tempest-VolumesNegativeTest-1159549234 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d288853f-9e0b-4a75-962e-95c313bcf56d tempest-VolumesNegativeTest-1159549234 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.140s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:08 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-d288853f-9e0b-4a75-962e-95c313bcf56d tempest-VolumesNegativeTest-1159549234 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:43:08 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-d288853f-9e0b-4a75-962e-95c313bcf56d tempest-VolumesNegativeTest-1159549234 None] Deleted volume successfully.
Sep 18 11:43:08 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-d288853f-9e0b-4a75-962e-95c313bcf56d tempest-VolumesNegativeTest-1159549234 None] Lock "cinder-f0f9b59e-ce26-4627-8b70-3be0e34d312a-delete_volume" released by "delete_volume" :: held 4.495s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:43:13 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 11:43:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:43:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:43:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:43:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:43:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:43:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.185s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:14 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:43:15 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-73d6e48f-bc28-4541-801d-1e2328f8bc08 tempest-VolumesSnapshotListTestJSON-1971010719 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:43:15 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-73d6e48f-bc28-4541-801d-1e2328f8bc08 tempest-VolumesSnapshotListTestJSON-1971010719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:43:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-73d6e48f-bc28-4541-801d-1e2328f8bc08 tempest-VolumesSnapshotListTestJSON-1971010719 None] Flow 'volume_create_manager' (12f22262-2e7f-426c-8b5d-715eb4a9da89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:43:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-73d6e48f-bc28-4541-801d-1e2328f8bc08 tempest-VolumesSnapshotListTestJSON-1971010719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd40c2b6-1341-4e0b-9433-caac8e3819f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-73d6e48f-bc28-4541-801d-1e2328f8bc08 tempest-VolumesSnapshotListTestJSON-1971010719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd40c2b6-1341-4e0b-9433-caac8e3819f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1053486305',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e1e3858479441ba7004fe12842ea97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:43:15Z,use_quota=True,user_id='31adf88cb4dd431a8d0be5a256fd3067',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-73d6e48f-bc28-4541-801d-1e2328f8bc08 tempest-VolumesSnapshotListTestJSON-1971010719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f316860d-05da-4d54-879e-40fa1064cab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-73d6e48f-bc28-4541-801d-1e2328f8bc08 tempest-VolumesSnapshotListTestJSON-1971010719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f316860d-05da-4d54-879e-40fa1064cab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-73d6e48f-bc28-4541-801d-1e2328f8bc08 tempest-VolumesSnapshotListTestJSON-1971010719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbc30e47-4a91-4767-ac82-302097ce10d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-73d6e48f-bc28-4541-801d-1e2328f8bc08 tempest-VolumesSnapshotListTestJSON-1971010719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbc30e47-4a91-4767-ac82-302097ce10d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a', 'volume_name': 'volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-73d6e48f-bc28-4541-801d-1e2328f8bc08 tempest-VolumesSnapshotListTestJSON-1971010719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (970493c3-e4d2-47fd-8f2b-202a27cd2f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-73d6e48f-bc28-4541-801d-1e2328f8bc08 tempest-VolumesSnapshotListTestJSON-1971010719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (970493c3-e4d2-47fd-8f2b-202a27cd2f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-73d6e48f-bc28-4541-801d-1e2328f8bc08 tempest-VolumesSnapshotListTestJSON-1971010719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6e139b5-23e2-4f3d-a846-be5b79c59435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:15 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-73d6e48f-bc28-4541-801d-1e2328f8bc08 tempest-VolumesSnapshotListTestJSON-1971010719 None] Volume a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a', 'volume_size': 1}
Sep 18 11:43:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-73d6e48f-bc28-4541-801d-1e2328f8bc08 tempest-VolumesSnapshotListTestJSON-1971010719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:43:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-73d6e48f-bc28-4541-801d-1e2328f8bc08 tempest-VolumesSnapshotListTestJSON-1971010719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:43:15 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-73d6e48f-bc28-4541-801d-1e2328f8bc08 tempest-VolumesSnapshotListTestJSON-1971010719 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1053486305',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e1e3858479441ba7004fe12842ea97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:43:15Z,use_quota=True,user_id='31adf88cb4dd431a8d0be5a256fd3067',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:43:15 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-73d6e48f-bc28-4541-801d-1e2328f8bc08 tempest-VolumesSnapshotListTestJSON-1971010719 None] Creating volume a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:43:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-73d6e48f-bc28-4541-801d-1e2328f8bc08 tempest-VolumesSnapshotListTestJSON-1971010719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:43:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-73d6e48f-bc28-4541-801d-1e2328f8bc08 tempest-VolumesSnapshotListTestJSON-1971010719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:43:15 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-73d6e48f-bc28-4541-801d-1e2328f8bc08 tempest-VolumesSnapshotListTestJSON-1971010719 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:43:15 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-73d6e48f-bc28-4541-801d-1e2328f8bc08 tempest-VolumesSnapshotListTestJSON-1971010719 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:43:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-73d6e48f-bc28-4541-801d-1e2328f8bc08 tempest-VolumesSnapshotListTestJSON-1971010719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:43:15 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-73d6e48f-bc28-4541-801d-1e2328f8bc08 tempest-VolumesSnapshotListTestJSON-1971010719 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:43:15 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-73d6e48f-bc28-4541-801d-1e2328f8bc08 tempest-VolumesSnapshotListTestJSON-1971010719 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:43:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-73d6e48f-bc28-4541-801d-1e2328f8bc08 tempest-VolumesSnapshotListTestJSON-1971010719 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:15 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=39, name=volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:43:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-73d6e48f-bc28-4541-801d-1e2328f8bc08 tempest-VolumesSnapshotListTestJSON-1971010719 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a 1073741824" returned: 0 in 0.550s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-73d6e48f-bc28-4541-801d-1e2328f8bc08 tempest-VolumesSnapshotListTestJSON-1971010719 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-73d6e48f-bc28-4541-801d-1e2328f8bc08 tempest-VolumesSnapshotListTestJSON-1971010719 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a" returned: 0 in 0.161s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:16 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-73d6e48f-bc28-4541-801d-1e2328f8bc08 tempest-VolumesSnapshotListTestJSON-1971010719 None] <== create_volume: return (805ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:43:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-73d6e48f-bc28-4541-801d-1e2328f8bc08 tempest-VolumesSnapshotListTestJSON-1971010719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:43:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-73d6e48f-bc28-4541-801d-1e2328f8bc08 tempest-VolumesSnapshotListTestJSON-1971010719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6e139b5-23e2-4f3d-a846-be5b79c59435) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-73d6e48f-bc28-4541-801d-1e2328f8bc08 tempest-VolumesSnapshotListTestJSON-1971010719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ef4c84c-f04d-4c73-8d5f-2d13e35975e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:16 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-73d6e48f-bc28-4541-801d-1e2328f8bc08 tempest-VolumesSnapshotListTestJSON-1971010719 None] Volume volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a (a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a): created successfully
Sep 18 11:43:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-73d6e48f-bc28-4541-801d-1e2328f8bc08 tempest-VolumesSnapshotListTestJSON-1971010719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ef4c84c-f04d-4c73-8d5f-2d13e35975e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-73d6e48f-bc28-4541-801d-1e2328f8bc08 tempest-VolumesSnapshotListTestJSON-1971010719 None] Flow 'volume_create_manager' (12f22262-2e7f-426c-8b5d-715eb4a9da89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:43:16 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-73d6e48f-bc28-4541-801d-1e2328f8bc08 tempest-VolumesSnapshotListTestJSON-1971010719 None] Created volume successfully.
Sep 18 11:43:18 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-22437216-b0e1-48ae-add2-acade33c1369 tempest-VolumesSnapshotListTestJSON-1971010719 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:43:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-22437216-b0e1-48ae-add2-acade33c1369 tempest-VolumesSnapshotListTestJSON-1971010719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:43:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-22437216-b0e1-48ae-add2-acade33c1369 tempest-VolumesSnapshotListTestJSON-1971010719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:43:18 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-22437216-b0e1-48ae-add2-acade33c1369 tempest-VolumesSnapshotListTestJSON-1971010719 None] Creating offline snapshot a27bba21-bad9-4b32-9098-c41810c35301 of volume a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a {{(pid=83176) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 11:43:18 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd093f46-60a0-4cfd-9f67-7a592764b1cb]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:43:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-22437216-b0e1-48ae-add2-acade33c1369 tempest-VolumesSnapshotListTestJSON-1971010719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-22437216-b0e1-48ae-add2-acade33c1369 tempest-VolumesSnapshotListTestJSON-1971010719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a" returned: 0 in 0.746s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-22437216-b0e1-48ae-add2-acade33c1369 tempest-VolumesSnapshotListTestJSON-1971010719 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.a27bba21-bad9-4b32-9098-c41810c35301 1G {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:19 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=40, name=volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.a27bba21-bad9-4b32-9098-c41810c35301, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:43:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-22437216-b0e1-48ae-add2-acade33c1369 tempest-VolumesSnapshotListTestJSON-1971010719 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.a27bba21-bad9-4b32-9098-c41810c35301 1G" returned: 0 in 0.333s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-22437216-b0e1-48ae-add2-acade33c1369 tempest-VolumesSnapshotListTestJSON-1971010719 None] Running cmd (subprocess): qemu-img rebase -u -b volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.a27bba21-bad9-4b32-9098-c41810c35301 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-22437216-b0e1-48ae-add2-acade33c1369 tempest-VolumesSnapshotListTestJSON-1971010719 None] CMD "qemu-img rebase -u -b volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.a27bba21-bad9-4b32-9098-c41810c35301" returned: 0 in 0.268s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:19 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-22437216-b0e1-48ae-add2-acade33c1369 tempest-VolumesSnapshotListTestJSON-1971010719 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.a27bba21-bad9-4b32-9098-c41810c35301 is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 11:43:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-22437216-b0e1-48ae-add2-acade33c1369 tempest-VolumesSnapshotListTestJSON-1971010719 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.a27bba21-bad9-4b32-9098-c41810c35301 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-22437216-b0e1-48ae-add2-acade33c1369 tempest-VolumesSnapshotListTestJSON-1971010719 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.a27bba21-bad9-4b32-9098-c41810c35301" returned: 0 in 0.112s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:20 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-22437216-b0e1-48ae-add2-acade33c1369 tempest-VolumesSnapshotListTestJSON-1971010719 None] Setting permissions: /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a -> 1000:1000 {{(pid=83176) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 11:43:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-22437216-b0e1-48ae-add2-acade33c1369 tempest-VolumesSnapshotListTestJSON-1971010719 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.a27bba21-bad9-4b32-9098-c41810c35301 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-22437216-b0e1-48ae-add2-acade33c1369 tempest-VolumesSnapshotListTestJSON-1971010719 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.a27bba21-bad9-4b32-9098-c41810c35301" returned: 0 in 0.108s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-22437216-b0e1-48ae-add2-acade33c1369 tempest-VolumesSnapshotListTestJSON-1971010719 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.info {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-22437216-b0e1-48ae-add2-acade33c1369 tempest-VolumesSnapshotListTestJSON-1971010719 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.info" returned: 0 in 0.142s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:20 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-22437216-b0e1-48ae-add2-acade33c1369 tempest-VolumesSnapshotListTestJSON-1971010719 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.info is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 11:43:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-22437216-b0e1-48ae-add2-acade33c1369 tempest-VolumesSnapshotListTestJSON-1971010719 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.info {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-22437216-b0e1-48ae-add2-acade33c1369 tempest-VolumesSnapshotListTestJSON-1971010719 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.info" returned: 0 in 0.129s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-22437216-b0e1-48ae-add2-acade33c1369 tempest-VolumesSnapshotListTestJSON-1971010719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.392s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:43:20 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-22437216-b0e1-48ae-add2-acade33c1369 tempest-VolumesSnapshotListTestJSON-1971010719 None] Create snapshot completed successfully
Sep 18 11:43:21 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-d2d4a37d-e0a9-419b-bd1b-a5770022d073 tempest-VolumesSnapshotListTestJSON-1971010719 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:43:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d2d4a37d-e0a9-419b-bd1b-a5770022d073 tempest-VolumesSnapshotListTestJSON-1971010719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:43:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d2d4a37d-e0a9-419b-bd1b-a5770022d073 tempest-VolumesSnapshotListTestJSON-1971010719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.008s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:43:21 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-d2d4a37d-e0a9-419b-bd1b-a5770022d073 tempest-VolumesSnapshotListTestJSON-1971010719 None] Creating offline snapshot 1c9523b6-0c0a-4ced-add5-35a405d53558 of volume a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a {{(pid=83176) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 11:43:21 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0504e2ba-e6a6-420c-9c5c-b2afdc15d5c6]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:43:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d2d4a37d-e0a9-419b-bd1b-a5770022d073 tempest-VolumesSnapshotListTestJSON-1971010719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.a27bba21-bad9-4b32-9098-c41810c35301 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d2d4a37d-e0a9-419b-bd1b-a5770022d073 tempest-VolumesSnapshotListTestJSON-1971010719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.a27bba21-bad9-4b32-9098-c41810c35301" returned: 0 in 0.496s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:22 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-d2d4a37d-e0a9-419b-bd1b-a5770022d073 tempest-VolumesSnapshotListTestJSON-1971010719 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 11:43:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d2d4a37d-e0a9-419b-bd1b-a5770022d073 tempest-VolumesSnapshotListTestJSON-1971010719 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.a27bba21-bad9-4b32-9098-c41810c35301,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.1c9523b6-0c0a-4ced-add5-35a405d53558 1G {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:22 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=42, name=volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.1c9523b6-0c0a-4ced-add5-35a405d53558, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:43:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d2d4a37d-e0a9-419b-bd1b-a5770022d073 tempest-VolumesSnapshotListTestJSON-1971010719 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.a27bba21-bad9-4b32-9098-c41810c35301,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.1c9523b6-0c0a-4ced-add5-35a405d53558 1G" returned: 0 in 0.280s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d2d4a37d-e0a9-419b-bd1b-a5770022d073 tempest-VolumesSnapshotListTestJSON-1971010719 None] Running cmd (subprocess): qemu-img rebase -u -b volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.a27bba21-bad9-4b32-9098-c41810c35301 -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.1c9523b6-0c0a-4ced-add5-35a405d53558 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:22 devstack quobyte-client[83193]: System call of process 91645 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:43:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d2d4a37d-e0a9-419b-bd1b-a5770022d073 tempest-VolumesSnapshotListTestJSON-1971010719 None] CMD "qemu-img rebase -u -b volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.a27bba21-bad9-4b32-9098-c41810c35301 -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.1c9523b6-0c0a-4ced-add5-35a405d53558" returned: 0 in 0.215s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:23 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-d2d4a37d-e0a9-419b-bd1b-a5770022d073 tempest-VolumesSnapshotListTestJSON-1971010719 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.1c9523b6-0c0a-4ced-add5-35a405d53558 is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 11:43:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d2d4a37d-e0a9-419b-bd1b-a5770022d073 tempest-VolumesSnapshotListTestJSON-1971010719 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.1c9523b6-0c0a-4ced-add5-35a405d53558 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d2d4a37d-e0a9-419b-bd1b-a5770022d073 tempest-VolumesSnapshotListTestJSON-1971010719 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.1c9523b6-0c0a-4ced-add5-35a405d53558" returned: 0 in 0.115s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:23 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-d2d4a37d-e0a9-419b-bd1b-a5770022d073 tempest-VolumesSnapshotListTestJSON-1971010719 None] Setting permissions: /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.a27bba21-bad9-4b32-9098-c41810c35301 -> 1000:1000 {{(pid=83176) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 11:43:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d2d4a37d-e0a9-419b-bd1b-a5770022d073 tempest-VolumesSnapshotListTestJSON-1971010719 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.a27bba21-bad9-4b32-9098-c41810c35301 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.1c9523b6-0c0a-4ced-add5-35a405d53558 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d2d4a37d-e0a9-419b-bd1b-a5770022d073 tempest-VolumesSnapshotListTestJSON-1971010719 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.a27bba21-bad9-4b32-9098-c41810c35301 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.1c9523b6-0c0a-4ced-add5-35a405d53558" returned: 0 in 0.116s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d2d4a37d-e0a9-419b-bd1b-a5770022d073 tempest-VolumesSnapshotListTestJSON-1971010719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.547s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:43:23 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-d2d4a37d-e0a9-419b-bd1b-a5770022d073 tempest-VolumesSnapshotListTestJSON-1971010719 None] Create snapshot completed successfully
Sep 18 11:43:24 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-b0332211-dfe8-41c1-9b14-02bfade2aad3 tempest-VolumesSnapshotListTestJSON-1971010719 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:43:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-b0332211-dfe8-41c1-9b14-02bfade2aad3 tempest-VolumesSnapshotListTestJSON-1971010719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:43:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-b0332211-dfe8-41c1-9b14-02bfade2aad3 tempest-VolumesSnapshotListTestJSON-1971010719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:43:24 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-b0332211-dfe8-41c1-9b14-02bfade2aad3 tempest-VolumesSnapshotListTestJSON-1971010719 None] Creating offline snapshot 6d6232d6-bf99-4cf4-b0c9-b412428a395c of volume a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a {{(pid=83176) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 11:43:24 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b767d7a6-ce0e-4bba-8181-0241a6881892]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:43:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b0332211-dfe8-41c1-9b14-02bfade2aad3 tempest-VolumesSnapshotListTestJSON-1971010719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.1c9523b6-0c0a-4ced-add5-35a405d53558 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b0332211-dfe8-41c1-9b14-02bfade2aad3 tempest-VolumesSnapshotListTestJSON-1971010719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.1c9523b6-0c0a-4ced-add5-35a405d53558" returned: 0 in 0.514s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:24 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-b0332211-dfe8-41c1-9b14-02bfade2aad3 tempest-VolumesSnapshotListTestJSON-1971010719 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 11:43:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b0332211-dfe8-41c1-9b14-02bfade2aad3 tempest-VolumesSnapshotListTestJSON-1971010719 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.1c9523b6-0c0a-4ced-add5-35a405d53558,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.6d6232d6-bf99-4cf4-b0c9-b412428a395c 1G {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:25 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=43, name=volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.6d6232d6-bf99-4cf4-b0c9-b412428a395c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:43:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b0332211-dfe8-41c1-9b14-02bfade2aad3 tempest-VolumesSnapshotListTestJSON-1971010719 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.1c9523b6-0c0a-4ced-add5-35a405d53558,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.6d6232d6-bf99-4cf4-b0c9-b412428a395c 1G" returned: 0 in 0.424s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b0332211-dfe8-41c1-9b14-02bfade2aad3 tempest-VolumesSnapshotListTestJSON-1971010719 None] Running cmd (subprocess): qemu-img rebase -u -b volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.1c9523b6-0c0a-4ced-add5-35a405d53558 -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.6d6232d6-bf99-4cf4-b0c9-b412428a395c {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:25 devstack quobyte-client[83193]: System call of process 91659 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:43:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b0332211-dfe8-41c1-9b14-02bfade2aad3 tempest-VolumesSnapshotListTestJSON-1971010719 None] CMD "qemu-img rebase -u -b volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.1c9523b6-0c0a-4ced-add5-35a405d53558 -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.6d6232d6-bf99-4cf4-b0c9-b412428a395c" returned: 0 in 0.219s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:25 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-b0332211-dfe8-41c1-9b14-02bfade2aad3 tempest-VolumesSnapshotListTestJSON-1971010719 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.6d6232d6-bf99-4cf4-b0c9-b412428a395c is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 11:43:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b0332211-dfe8-41c1-9b14-02bfade2aad3 tempest-VolumesSnapshotListTestJSON-1971010719 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.6d6232d6-bf99-4cf4-b0c9-b412428a395c {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b0332211-dfe8-41c1-9b14-02bfade2aad3 tempest-VolumesSnapshotListTestJSON-1971010719 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.6d6232d6-bf99-4cf4-b0c9-b412428a395c" returned: 0 in 0.086s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:25 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-b0332211-dfe8-41c1-9b14-02bfade2aad3 tempest-VolumesSnapshotListTestJSON-1971010719 None] Setting permissions: /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.1c9523b6-0c0a-4ced-add5-35a405d53558 -> 1000:1000 {{(pid=83176) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 11:43:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b0332211-dfe8-41c1-9b14-02bfade2aad3 tempest-VolumesSnapshotListTestJSON-1971010719 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.1c9523b6-0c0a-4ced-add5-35a405d53558 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.6d6232d6-bf99-4cf4-b0c9-b412428a395c {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b0332211-dfe8-41c1-9b14-02bfade2aad3 tempest-VolumesSnapshotListTestJSON-1971010719 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.1c9523b6-0c0a-4ced-add5-35a405d53558 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.6d6232d6-bf99-4cf4-b0c9-b412428a395c" returned: 0 in 0.079s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-b0332211-dfe8-41c1-9b14-02bfade2aad3 tempest-VolumesSnapshotListTestJSON-1971010719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.617s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:43:26 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-b0332211-dfe8-41c1-9b14-02bfade2aad3 tempest-VolumesSnapshotListTestJSON-1971010719 None] Create snapshot completed successfully
Sep 18 11:43:28 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-2a2ccbbb-0c1b-4c19-b2b5-b564aa8e26b1 tempest-VolumesSnapshotListTestJSON-1971010719 None] Acquiring lock "cinder-6d6232d6-bf99-4cf4-b0c9-b412428a395c-delete_snapshot" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:43:28 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-2a2ccbbb-0c1b-4c19-b2b5-b564aa8e26b1 tempest-VolumesSnapshotListTestJSON-1971010719 None] Lock "cinder-6d6232d6-bf99-4cf4-b0c9-b412428a395c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.073s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:43:28 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-2a2ccbbb-0c1b-4c19-b2b5-b564aa8e26b1 tempest-VolumesSnapshotListTestJSON-1971010719 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:43:28 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-2a2ccbbb-0c1b-4c19-b2b5-b564aa8e26b1 tempest-VolumesSnapshotListTestJSON-1971010719 None] Acquiring lock "cinder-quobyte-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:43:28 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-2a2ccbbb-0c1b-4c19-b2b5-b564aa8e26b1 tempest-VolumesSnapshotListTestJSON-1971010719 None] Lock "cinder-quobyte-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:43:28 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-2a2ccbbb-0c1b-4c19-b2b5-b564aa8e26b1 tempest-VolumesSnapshotListTestJSON-1971010719 None] Acquiring lock "cinder-quobyte-6d6232d6-bf99-4cf4-b0c9-b412428a395c" by "_delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:43:28 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-2a2ccbbb-0c1b-4c19-b2b5-b564aa8e26b1 tempest-VolumesSnapshotListTestJSON-1971010719 None] Lock "cinder-quobyte-6d6232d6-bf99-4cf4-b0c9-b412428a395c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:43:28 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-2a2ccbbb-0c1b-4c19-b2b5-b564aa8e26b1 tempest-VolumesSnapshotListTestJSON-1971010719 None] Deleting offline snapshot 6d6232d6-bf99-4cf4-b0c9-b412428a395c of volume a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 11:43:28 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-2a2ccbbb-0c1b-4c19-b2b5-b564aa8e26b1 tempest-VolumesSnapshotListTestJSON-1971010719 None] snapshot_file for this snap is: volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.6d6232d6-bf99-4cf4-b0c9-b412428a395c {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 11:43:28 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1bf4968-7cb1-4129-afc1-6e2aa5a366e6]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:43:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2a2ccbbb-0c1b-4c19-b2b5-b564aa8e26b1 tempest-VolumesSnapshotListTestJSON-1971010719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.6d6232d6-bf99-4cf4-b0c9-b412428a395c {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2a2ccbbb-0c1b-4c19-b2b5-b564aa8e26b1 tempest-VolumesSnapshotListTestJSON-1971010719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.6d6232d6-bf99-4cf4-b0c9-b412428a395c" returned: 0 in 0.888s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:29 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-2a2ccbbb-0c1b-4c19-b2b5-b564aa8e26b1 tempest-VolumesSnapshotListTestJSON-1971010719 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 11:43:29 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[118465cb-e3d7-49ad-bcfa-5da21a969efa]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:43:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2a2ccbbb-0c1b-4c19-b2b5-b564aa8e26b1 tempest-VolumesSnapshotListTestJSON-1971010719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.1c9523b6-0c0a-4ced-add5-35a405d53558 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2a2ccbbb-0c1b-4c19-b2b5-b564aa8e26b1 tempest-VolumesSnapshotListTestJSON-1971010719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.1c9523b6-0c0a-4ced-add5-35a405d53558" returned: 0 in 0.535s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:30 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-2a2ccbbb-0c1b-4c19-b2b5-b564aa8e26b1 tempest-VolumesSnapshotListTestJSON-1971010719 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 11:43:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2a2ccbbb-0c1b-4c19-b2b5-b564aa8e26b1 tempest-VolumesSnapshotListTestJSON-1971010719 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.6d6232d6-bf99-4cf4-b0c9-b412428a395c {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2a2ccbbb-0c1b-4c19-b2b5-b564aa8e26b1 tempest-VolumesSnapshotListTestJSON-1971010719 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.6d6232d6-bf99-4cf4-b0c9-b412428a395c" returned: 0 in 0.404s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2a2ccbbb-0c1b-4c19-b2b5-b564aa8e26b1 tempest-VolumesSnapshotListTestJSON-1971010719 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.6d6232d6-bf99-4cf4-b0c9-b412428a395c {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2a2ccbbb-0c1b-4c19-b2b5-b564aa8e26b1 tempest-VolumesSnapshotListTestJSON-1971010719 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.6d6232d6-bf99-4cf4-b0c9-b412428a395c" returned: 0 in 0.256s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:31 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-2a2ccbbb-0c1b-4c19-b2b5-b564aa8e26b1 tempest-VolumesSnapshotListTestJSON-1971010719 None] Lock "cinder-quobyte-6d6232d6-bf99-4cf4-b0c9-b412428a395c" released by "_delete_snapshot" :: held 2.584s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:43:31 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-2a2ccbbb-0c1b-4c19-b2b5-b564aa8e26b1 tempest-VolumesSnapshotListTestJSON-1971010719 None] Lock "cinder-quobyte-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a" released by "delete_snapshot" :: held 2.623s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:43:31 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-2a2ccbbb-0c1b-4c19-b2b5-b564aa8e26b1 tempest-VolumesSnapshotListTestJSON-1971010719 None] Created reservations ['68f0aeec-616a-4adb-9e70-2039885baca7', '9a89c1bd-f2fb-47c8-b0d1-c68b987e1149', 'c66e705f-92f6-4b1e-be37-986f49e84fc3', 'c0a1b4ac-b14a-4446-aec9-e689de117c93'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:43:31 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-2a2ccbbb-0c1b-4c19-b2b5-b564aa8e26b1 tempest-VolumesSnapshotListTestJSON-1971010719 None] Delete snapshot completed successfully.
Sep 18 11:43:31 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-2a2ccbbb-0c1b-4c19-b2b5-b564aa8e26b1 tempest-VolumesSnapshotListTestJSON-1971010719 None] Lock "cinder-6d6232d6-bf99-4cf4-b0c9-b412428a395c-delete_snapshot" released by "delete_snapshot" :: held 3.098s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:43:32 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-e674ce35-3ed2-43a1-a11d-f55dd098d09c tempest-VolumesSnapshotListTestJSON-1971010719 None] Acquiring lock "cinder-1c9523b6-0c0a-4ced-add5-35a405d53558-delete_snapshot" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:43:32 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-e674ce35-3ed2-43a1-a11d-f55dd098d09c tempest-VolumesSnapshotListTestJSON-1971010719 None] Lock "cinder-1c9523b6-0c0a-4ced-add5-35a405d53558-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:43:32 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-e674ce35-3ed2-43a1-a11d-f55dd098d09c tempest-VolumesSnapshotListTestJSON-1971010719 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:43:32 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-e674ce35-3ed2-43a1-a11d-f55dd098d09c tempest-VolumesSnapshotListTestJSON-1971010719 None] Acquiring lock "cinder-quobyte-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:43:32 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-e674ce35-3ed2-43a1-a11d-f55dd098d09c tempest-VolumesSnapshotListTestJSON-1971010719 None] Lock "cinder-quobyte-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a" acquired by "delete_snapshot" :: waited 0.036s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:43:32 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-e674ce35-3ed2-43a1-a11d-f55dd098d09c tempest-VolumesSnapshotListTestJSON-1971010719 None] Acquiring lock "cinder-quobyte-1c9523b6-0c0a-4ced-add5-35a405d53558" by "_delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:43:32 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-e674ce35-3ed2-43a1-a11d-f55dd098d09c tempest-VolumesSnapshotListTestJSON-1971010719 None] Lock "cinder-quobyte-1c9523b6-0c0a-4ced-add5-35a405d53558" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:43:32 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-e674ce35-3ed2-43a1-a11d-f55dd098d09c tempest-VolumesSnapshotListTestJSON-1971010719 None] Deleting offline snapshot 1c9523b6-0c0a-4ced-add5-35a405d53558 of volume a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 11:43:32 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-e674ce35-3ed2-43a1-a11d-f55dd098d09c tempest-VolumesSnapshotListTestJSON-1971010719 None] snapshot_file for this snap is: volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.1c9523b6-0c0a-4ced-add5-35a405d53558 {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 11:43:32 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bec7a28-25c2-4880-a732-3a003449bcf8]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:43:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-e674ce35-3ed2-43a1-a11d-f55dd098d09c tempest-VolumesSnapshotListTestJSON-1971010719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.1c9523b6-0c0a-4ced-add5-35a405d53558 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-e674ce35-3ed2-43a1-a11d-f55dd098d09c tempest-VolumesSnapshotListTestJSON-1971010719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.1c9523b6-0c0a-4ced-add5-35a405d53558" returned: 0 in 0.515s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:32 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-e674ce35-3ed2-43a1-a11d-f55dd098d09c tempest-VolumesSnapshotListTestJSON-1971010719 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 11:43:33 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a627869-cb44-4037-a142-f7efce90ff84]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:43:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-e674ce35-3ed2-43a1-a11d-f55dd098d09c tempest-VolumesSnapshotListTestJSON-1971010719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.a27bba21-bad9-4b32-9098-c41810c35301 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:33 devstack quobyte-client[83193]: System call of process 91716 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:43:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-e674ce35-3ed2-43a1-a11d-f55dd098d09c tempest-VolumesSnapshotListTestJSON-1971010719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.a27bba21-bad9-4b32-9098-c41810c35301" returned: 0 in 0.841s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:33 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-e674ce35-3ed2-43a1-a11d-f55dd098d09c tempest-VolumesSnapshotListTestJSON-1971010719 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 11:43:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-e674ce35-3ed2-43a1-a11d-f55dd098d09c tempest-VolumesSnapshotListTestJSON-1971010719 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.1c9523b6-0c0a-4ced-add5-35a405d53558 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:34 devstack quobyte-client[83193]: System call of process 91725 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:43:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-e674ce35-3ed2-43a1-a11d-f55dd098d09c tempest-VolumesSnapshotListTestJSON-1971010719 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.1c9523b6-0c0a-4ced-add5-35a405d53558" returned: 0 in 0.438s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-e674ce35-3ed2-43a1-a11d-f55dd098d09c tempest-VolumesSnapshotListTestJSON-1971010719 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.1c9523b6-0c0a-4ced-add5-35a405d53558 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-e674ce35-3ed2-43a1-a11d-f55dd098d09c tempest-VolumesSnapshotListTestJSON-1971010719 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.1c9523b6-0c0a-4ced-add5-35a405d53558" returned: 0 in 0.293s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:34 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-e674ce35-3ed2-43a1-a11d-f55dd098d09c tempest-VolumesSnapshotListTestJSON-1971010719 None] Lock "cinder-quobyte-1c9523b6-0c0a-4ced-add5-35a405d53558" released by "_delete_snapshot" :: held 2.618s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:43:34 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-e674ce35-3ed2-43a1-a11d-f55dd098d09c tempest-VolumesSnapshotListTestJSON-1971010719 None] Lock "cinder-quobyte-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a" released by "delete_snapshot" :: held 2.654s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:43:35 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-e674ce35-3ed2-43a1-a11d-f55dd098d09c tempest-VolumesSnapshotListTestJSON-1971010719 None] Created reservations ['fd0fe4f3-1cf2-4482-ac75-d9b87bc7c96c', 'faa8f83b-5c56-42f9-a732-4446c719b9bf', 'b7f6b4be-8082-4f4c-a9da-fa4ea5bbbde4', '42db1a50-5c43-4baa-9c2f-edfe216f1059'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:43:35 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-e674ce35-3ed2-43a1-a11d-f55dd098d09c tempest-VolumesSnapshotListTestJSON-1971010719 None] Delete snapshot completed successfully.
Sep 18 11:43:35 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-e674ce35-3ed2-43a1-a11d-f55dd098d09c tempest-VolumesSnapshotListTestJSON-1971010719 None] Lock "cinder-1c9523b6-0c0a-4ced-add5-35a405d53558-delete_snapshot" released by "delete_snapshot" :: held 3.480s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:43:36 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-48eb1948-1785-4444-b4b5-7a07d005675c tempest-VolumesSnapshotListTestJSON-1971010719 None] Acquiring lock "cinder-a27bba21-bad9-4b32-9098-c41810c35301-delete_snapshot" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:43:36 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-48eb1948-1785-4444-b4b5-7a07d005675c tempest-VolumesSnapshotListTestJSON-1971010719 None] Lock "cinder-a27bba21-bad9-4b32-9098-c41810c35301-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:43:36 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-48eb1948-1785-4444-b4b5-7a07d005675c tempest-VolumesSnapshotListTestJSON-1971010719 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:43:36 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-48eb1948-1785-4444-b4b5-7a07d005675c tempest-VolumesSnapshotListTestJSON-1971010719 None] Acquiring lock "cinder-quobyte-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:43:36 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-48eb1948-1785-4444-b4b5-7a07d005675c tempest-VolumesSnapshotListTestJSON-1971010719 None] Lock "cinder-quobyte-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:43:36 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-48eb1948-1785-4444-b4b5-7a07d005675c tempest-VolumesSnapshotListTestJSON-1971010719 None] Acquiring lock "cinder-quobyte-a27bba21-bad9-4b32-9098-c41810c35301" by "_delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:43:36 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-48eb1948-1785-4444-b4b5-7a07d005675c tempest-VolumesSnapshotListTestJSON-1971010719 None] Lock "cinder-quobyte-a27bba21-bad9-4b32-9098-c41810c35301" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:43:36 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-48eb1948-1785-4444-b4b5-7a07d005675c tempest-VolumesSnapshotListTestJSON-1971010719 None] Deleting offline snapshot a27bba21-bad9-4b32-9098-c41810c35301 of volume a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 11:43:36 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-48eb1948-1785-4444-b4b5-7a07d005675c tempest-VolumesSnapshotListTestJSON-1971010719 None] snapshot_file for this snap is: volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.a27bba21-bad9-4b32-9098-c41810c35301 {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 11:43:36 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbdefbb-a77b-4e1b-a6ec-315e5bca7a10]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:43:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-48eb1948-1785-4444-b4b5-7a07d005675c tempest-VolumesSnapshotListTestJSON-1971010719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.a27bba21-bad9-4b32-9098-c41810c35301 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-48eb1948-1785-4444-b4b5-7a07d005675c tempest-VolumesSnapshotListTestJSON-1971010719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.a27bba21-bad9-4b32-9098-c41810c35301" returned: 0 in 0.742s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:37 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-48eb1948-1785-4444-b4b5-7a07d005675c tempest-VolumesSnapshotListTestJSON-1971010719 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 11:43:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-f4118615-1e67-47c3-bbc8-4cba62c199d5 req-9925d47d-bc08-463f-a86b-832b3c42c8e8 tempest-AttachVolumeShelveTestJSON-1847875693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:43:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-f4118615-1e67-47c3-bbc8-4cba62c199d5 req-9925d47d-bc08-463f-a86b-832b3c42c8e8 tempest-AttachVolumeShelveTestJSON-1847875693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:43:37 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d97156-5bc9-4067-8ccf-7b92aa246cf7]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:43:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-48eb1948-1785-4444-b4b5-7a07d005675c tempest-VolumesSnapshotListTestJSON-1971010719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:37 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a50123-9c6f-474f-b1a6-342f5c7850a8]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:43:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-f4118615-1e67-47c3-bbc8-4cba62c199d5 req-9925d47d-bc08-463f-a86b-832b3c42c8e8 tempest-AttachVolumeShelveTestJSON-1847875693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1298a5e2-b3cd-4867-bc42-f76f9c8d14a1 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:38 devstack quobyte-client[83193]: System call of process 91752 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:43:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-48eb1948-1785-4444-b4b5-7a07d005675c tempest-VolumesSnapshotListTestJSON-1971010719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a" returned: 0 in 0.603s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-48eb1948-1785-4444-b4b5-7a07d005675c tempest-VolumesSnapshotListTestJSON-1971010719 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.a27bba21-bad9-4b32-9098-c41810c35301 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-48eb1948-1785-4444-b4b5-7a07d005675c tempest-VolumesSnapshotListTestJSON-1971010719 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.a27bba21-bad9-4b32-9098-c41810c35301" returned: 0 in 0.414s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-48eb1948-1785-4444-b4b5-7a07d005675c tempest-VolumesSnapshotListTestJSON-1971010719 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.a27bba21-bad9-4b32-9098-c41810c35301 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:39 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-f4118615-1e67-47c3-bbc8-4cba62c199d5 req-9925d47d-bc08-463f-a86b-832b3c42c8e8 tempest-AttachVolumeShelveTestJSON-1847875693 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1298a5e2-b3cd-4867-bc42-f76f9c8d14a1" returned: 0 in 1.144s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:39 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-f4118615-1e67-47c3-bbc8-4cba62c199d5 req-9925d47d-bc08-463f-a86b-832b3c42c8e8 tempest-AttachVolumeShelveTestJSON-1847875693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.470s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:43:39 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-48eb1948-1785-4444-b4b5-7a07d005675c tempest-VolumesSnapshotListTestJSON-1971010719 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a.a27bba21-bad9-4b32-9098-c41810c35301" returned: 0 in 0.477s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:39 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-f4118615-1e67-47c3-bbc8-4cba62c199d5 req-9925d47d-bc08-463f-a86b-832b3c42c8e8 tempest-AttachVolumeShelveTestJSON-1847875693 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8', 'name': 'volume-1298a5e2-b3cd-4867-bc42-f76f9c8d14a1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '22caa9c6-5ce8-4140-809f-0f2a32e32524', 'enforce_multipath': True} {{(pid=83176) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 11:43:39 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-f4118615-1e67-47c3-bbc8-4cba62c199d5 req-9925d47d-bc08-463f-a86b-832b3c42c8e8 tempest-AttachVolumeShelveTestJSON-1847875693 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:43:39 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-48eb1948-1785-4444-b4b5-7a07d005675c tempest-VolumesSnapshotListTestJSON-1971010719 None] Lock "cinder-quobyte-a27bba21-bad9-4b32-9098-c41810c35301" released by "_delete_snapshot" :: held 2.664s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:43:39 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-48eb1948-1785-4444-b4b5-7a07d005675c tempest-VolumesSnapshotListTestJSON-1971010719 None] Lock "cinder-quobyte-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a" released by "delete_snapshot" :: held 2.728s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:43:39 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-f4118615-1e67-47c3-bbc8-4cba62c199d5 req-9925d47d-bc08-463f-a86b-832b3c42c8e8 tempest-AttachVolumeShelveTestJSON-1847875693 None] attachment_update completed successfully.
Sep 18 11:43:39 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-48eb1948-1785-4444-b4b5-7a07d005675c tempest-VolumesSnapshotListTestJSON-1971010719 None] Created reservations ['1e2d8426-9e4d-4ffa-b76e-abd50927fe2b', '7e42c859-1047-4996-8819-7ba97f4356cd', 'a87f1b28-84ea-4c8d-abab-48dd74af800b', 'e6f1ccff-7591-4094-b6ea-98f925e61856'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:43:39 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-48eb1948-1785-4444-b4b5-7a07d005675c tempest-VolumesSnapshotListTestJSON-1971010719 None] Delete snapshot completed successfully.
Sep 18 11:43:39 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-48eb1948-1785-4444-b4b5-7a07d005675c tempest-VolumesSnapshotListTestJSON-1971010719 None] Lock "cinder-a27bba21-bad9-4b32-9098-c41810c35301-delete_snapshot" released by "delete_snapshot" :: held 3.071s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:43:40 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4b89f1d9-018a-4f4e-94d6-ccbc9f743d84 tempest-VolumesSnapshotListTestJSON-1971010719 None] Acquiring lock "cinder-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:43:40 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4b89f1d9-018a-4f4e-94d6-ccbc9f743d84 tempest-VolumesSnapshotListTestJSON-1971010719 None] Lock "cinder-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:43:40 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-4b89f1d9-018a-4f4e-94d6-ccbc9f743d84 tempest-VolumesSnapshotListTestJSON-1971010719 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:43:40 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4b89f1d9-018a-4f4e-94d6-ccbc9f743d84 tempest-VolumesSnapshotListTestJSON-1971010719 None] Acquiring lock "cinder-quobyte-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:43:40 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4b89f1d9-018a-4f4e-94d6-ccbc9f743d84 tempest-VolumesSnapshotListTestJSON-1971010719 None] Lock "cinder-quobyte-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a" acquired by "delete_volume" :: waited 0.010s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:43:40 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1532babc-d817-4d62-a5c7-948954580112]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:43:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4b89f1d9-018a-4f4e-94d6-ccbc9f743d84 tempest-VolumesSnapshotListTestJSON-1971010719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4b89f1d9-018a-4f4e-94d6-ccbc9f743d84 tempest-VolumesSnapshotListTestJSON-1971010719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a" returned: 0 in 0.554s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4b89f1d9-018a-4f4e-94d6-ccbc9f743d84 tempest-VolumesSnapshotListTestJSON-1971010719 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4b89f1d9-018a-4f4e-94d6-ccbc9f743d84 tempest-VolumesSnapshotListTestJSON-1971010719 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a" returned: 0 in 0.145s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:41 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4b89f1d9-018a-4f4e-94d6-ccbc9f743d84 tempest-VolumesSnapshotListTestJSON-1971010719 None] Lock "cinder-quobyte-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a" released by "delete_volume" :: held 0.930s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:43:42 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-4b89f1d9-018a-4f4e-94d6-ccbc9f743d84 tempest-VolumesSnapshotListTestJSON-1971010719 None] Created reservations ['7cafd9ee-8e45-4b0c-bc9b-d959abfcff73', '4b1a49f3-fdca-4018-8e08-26caef376b33', '96e585ec-16b9-4b9d-be53-e7861da713e2', '61d4bd93-508a-4797-a02c-9a9a3449a55d'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:43:42 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4b89f1d9-018a-4f4e-94d6-ccbc9f743d84 tempest-VolumesSnapshotListTestJSON-1971010719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:43:42 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4b89f1d9-018a-4f4e-94d6-ccbc9f743d84 tempest-VolumesSnapshotListTestJSON-1971010719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:43:42 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-4b89f1d9-018a-4f4e-94d6-ccbc9f743d84 tempest-VolumesSnapshotListTestJSON-1971010719 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:43:42 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-4b89f1d9-018a-4f4e-94d6-ccbc9f743d84 tempest-VolumesSnapshotListTestJSON-1971010719 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:43:42 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4b89f1d9-018a-4f4e-94d6-ccbc9f743d84 tempest-VolumesSnapshotListTestJSON-1971010719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:43:42 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4b89f1d9-018a-4f4e-94d6-ccbc9f743d84 tempest-VolumesSnapshotListTestJSON-1971010719 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:42 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4b89f1d9-018a-4f4e-94d6-ccbc9f743d84 tempest-VolumesSnapshotListTestJSON-1971010719 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.165s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:42 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-4b89f1d9-018a-4f4e-94d6-ccbc9f743d84 tempest-VolumesSnapshotListTestJSON-1971010719 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:43:42 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-4b89f1d9-018a-4f4e-94d6-ccbc9f743d84 tempest-VolumesSnapshotListTestJSON-1971010719 None] Deleted volume successfully.
Sep 18 11:43:43 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4b89f1d9-018a-4f4e-94d6-ccbc9f743d84 tempest-VolumesSnapshotListTestJSON-1971010719 None] Lock "cinder-a1aa99d4-71e2-4f2b-ac71-bcb5b8e9550a-delete_volume" released by "delete_volume" :: held 2.609s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:43:48 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-3fb689f2-21a7-4593-a293-dd364033ecac tempest-CreateVolumesFromImageTest-217997605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:43:48 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fb689f2-21a7-4593-a293-dd364033ecac tempest-CreateVolumesFromImageTest-217997605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:43:49 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3fb689f2-21a7-4593-a293-dd364033ecac tempest-CreateVolumesFromImageTest-217997605 None] Flow 'volume_create_manager' (ad12a6d9-2508-424b-937d-55ede4928f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:43:49 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3fb689f2-21a7-4593-a293-dd364033ecac tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d28f407-2531-4244-9640-926946d10df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:49 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3fb689f2-21a7-4593-a293-dd364033ecac tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d28f407-2531-4244-9640-926946d10df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-694249144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bffa85a2-c61a-44d1-b5b7-dc93fe1d1a06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c8736886f484443ac00436dc0a1ddbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:43:48Z,use_quota=True,user_id='229e992549654633a4fba8fa52942967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:49 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3fb689f2-21a7-4593-a293-dd364033ecac tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (438b80a8-5bd0-4419-b6f0-487a1ab9b44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:49 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3fb689f2-21a7-4593-a293-dd364033ecac tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (438b80a8-5bd0-4419-b6f0-487a1ab9b44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:49 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3fb689f2-21a7-4593-a293-dd364033ecac tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b0ee9bc-0a3c-405c-bf6b-2d186eb74900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:49 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3fb689f2-21a7-4593-a293-dd364033ecac tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b0ee9bc-0a3c-405c-bf6b-2d186eb74900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bffa85a2-c61a-44d1-b5b7-dc93fe1d1a06', 'volume_name': 'volume-bffa85a2-c61a-44d1-b5b7-dc93fe1d1a06', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:49 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3fb689f2-21a7-4593-a293-dd364033ecac tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab7c6b39-c146-4458-bb5e-705428223ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:49 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3fb689f2-21a7-4593-a293-dd364033ecac tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab7c6b39-c146-4458-bb5e-705428223ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:49 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3fb689f2-21a7-4593-a293-dd364033ecac tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f067f747-0310-47c3-ad7e-8a244cff9898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:49 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-3fb689f2-21a7-4593-a293-dd364033ecac tempest-CreateVolumesFromImageTest-217997605 None] Volume bffa85a2-c61a-44d1-b5b7-dc93fe1d1a06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bffa85a2-c61a-44d1-b5b7-dc93fe1d1a06', 'volume_size': 1}
Sep 18 11:43:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-3fb689f2-21a7-4593-a293-dd364033ecac tempest-CreateVolumesFromImageTest-217997605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:43:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-3fb689f2-21a7-4593-a293-dd364033ecac tempest-CreateVolumesFromImageTest-217997605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:43:49 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-3fb689f2-21a7-4593-a293-dd364033ecac tempest-CreateVolumesFromImageTest-217997605 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-694249144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bffa85a2-c61a-44d1-b5b7-dc93fe1d1a06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c8736886f484443ac00436dc0a1ddbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:43:48Z,use_quota=True,user_id='229e992549654633a4fba8fa52942967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:43:49 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-3fb689f2-21a7-4593-a293-dd364033ecac tempest-CreateVolumesFromImageTest-217997605 None] Creating volume bffa85a2-c61a-44d1-b5b7-dc93fe1d1a06 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:43:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-3fb689f2-21a7-4593-a293-dd364033ecac tempest-CreateVolumesFromImageTest-217997605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:43:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-3fb689f2-21a7-4593-a293-dd364033ecac tempest-CreateVolumesFromImageTest-217997605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:43:49 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-3fb689f2-21a7-4593-a293-dd364033ecac tempest-CreateVolumesFromImageTest-217997605 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:43:49 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-3fb689f2-21a7-4593-a293-dd364033ecac tempest-CreateVolumesFromImageTest-217997605 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:43:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-3fb689f2-21a7-4593-a293-dd364033ecac tempest-CreateVolumesFromImageTest-217997605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:43:49 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-3fb689f2-21a7-4593-a293-dd364033ecac tempest-CreateVolumesFromImageTest-217997605 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:43:49 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-3fb689f2-21a7-4593-a293-dd364033ecac tempest-CreateVolumesFromImageTest-217997605 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:43:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-3fb689f2-21a7-4593-a293-dd364033ecac tempest-CreateVolumesFromImageTest-217997605 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-bffa85a2-c61a-44d1-b5b7-dc93fe1d1a06 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:49 devstack quobyte-client[83193]: System call of process 91775 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:43:50 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=44, name=volume-bffa85a2-c61a-44d1-b5b7-dc93fe1d1a06, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:43:51 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-3b261d88-3128-49e1-8077-32709e4b28ab tempest-AttachVolumeNegativeTest-652039892 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:43:51 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b261d88-3128-49e1-8077-32709e4b28ab tempest-AttachVolumeNegativeTest-652039892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:43:51 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3b261d88-3128-49e1-8077-32709e4b28ab tempest-AttachVolumeNegativeTest-652039892 None] Flow 'volume_create_manager' (581c6a87-1389-4746-866a-5abaaeb7d5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:43:51 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3b261d88-3128-49e1-8077-32709e4b28ab tempest-AttachVolumeNegativeTest-652039892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (546109bb-fa5d-4aa3-a2f2-23cd1d98fc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:52 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3b261d88-3128-49e1-8077-32709e4b28ab tempest-AttachVolumeNegativeTest-652039892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (546109bb-fa5d-4aa3-a2f2-23cd1d98fc83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-39961515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=676aee41-6692-408d-9c94-92c2698e6004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a05d56cebf4a648f8e1448c266b3a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:43:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:43:49Z,use_quota=True,user_id='601cfe954e21466cb2aa683fe69a2b53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:52 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3b261d88-3128-49e1-8077-32709e4b28ab tempest-AttachVolumeNegativeTest-652039892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26eae945-5c6f-4eee-8f78-3e19c98c66ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:52 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3b261d88-3128-49e1-8077-32709e4b28ab tempest-AttachVolumeNegativeTest-652039892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26eae945-5c6f-4eee-8f78-3e19c98c66ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:52 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3b261d88-3128-49e1-8077-32709e4b28ab tempest-AttachVolumeNegativeTest-652039892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7098756f-01f5-462e-8efe-15e1254d2167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:52 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3b261d88-3128-49e1-8077-32709e4b28ab tempest-AttachVolumeNegativeTest-652039892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7098756f-01f5-462e-8efe-15e1254d2167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '676aee41-6692-408d-9c94-92c2698e6004', 'volume_name': 'volume-676aee41-6692-408d-9c94-92c2698e6004', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:52 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3b261d88-3128-49e1-8077-32709e4b28ab tempest-AttachVolumeNegativeTest-652039892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f4a7d0-b052-4565-b89a-7965c1b4bfd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:52 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3b261d88-3128-49e1-8077-32709e4b28ab tempest-AttachVolumeNegativeTest-652039892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f4a7d0-b052-4565-b89a-7965c1b4bfd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:52 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3b261d88-3128-49e1-8077-32709e4b28ab tempest-AttachVolumeNegativeTest-652039892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02952406-b902-4438-baa7-97450116399f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:52 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-3b261d88-3128-49e1-8077-32709e4b28ab tempest-AttachVolumeNegativeTest-652039892 None] Volume 676aee41-6692-408d-9c94-92c2698e6004: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-676aee41-6692-408d-9c94-92c2698e6004', 'volume_size': 1}
Sep 18 11:43:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-3b261d88-3128-49e1-8077-32709e4b28ab tempest-AttachVolumeNegativeTest-652039892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:43:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-3fb689f2-21a7-4593-a293-dd364033ecac tempest-CreateVolumesFromImageTest-217997605 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-bffa85a2-c61a-44d1-b5b7-dc93fe1d1a06 1073741824" returned: 0 in 2.665s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-3fb689f2-21a7-4593-a293-dd364033ecac tempest-CreateVolumesFromImageTest-217997605 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-bffa85a2-c61a-44d1-b5b7-dc93fe1d1a06 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:53 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-0018c85a-1457-4c79-8751-223ebbd4c92a tempest-CreateVolumesFromImageTest-217997605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:43:53 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-0018c85a-1457-4c79-8751-223ebbd4c92a tempest-CreateVolumesFromImageTest-217997605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:43:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0018c85a-1457-4c79-8751-223ebbd4c92a tempest-CreateVolumesFromImageTest-217997605 None] Flow 'volume_create_manager' (255811ec-23c5-4ab3-b6a8-012b39022551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:43:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0018c85a-1457-4c79-8751-223ebbd4c92a tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c76fdce-6e74-490a-b679-adbbd4deb284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-3fb689f2-21a7-4593-a293-dd364033ecac tempest-CreateVolumesFromImageTest-217997605 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-bffa85a2-c61a-44d1-b5b7-dc93fe1d1a06" returned: 0 in 1.087s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:53 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-3fb689f2-21a7-4593-a293-dd364033ecac tempest-CreateVolumesFromImageTest-217997605 None] <== create_volume: return (3849ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:43:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-3fb689f2-21a7-4593-a293-dd364033ecac tempest-CreateVolumesFromImageTest-217997605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.867s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:43:53 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-a4b944f8-da28-456e-b10f-1330ffc0dd22 tempest-CreateVolumesFromImageTest-217997605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:43:53 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4b944f8-da28-456e-b10f-1330ffc0dd22 tempest-CreateVolumesFromImageTest-217997605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:43:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-a4b944f8-da28-456e-b10f-1330ffc0dd22 tempest-CreateVolumesFromImageTest-217997605 None] Flow 'volume_create_manager' (2967818d-e266-4fba-977d-dd09b8bce5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:43:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-a4b944f8-da28-456e-b10f-1330ffc0dd22 tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (718beb45-bdaf-4112-9259-265f82a0b93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-3b261d88-3128-49e1-8077-32709e4b28ab tempest-AttachVolumeNegativeTest-652039892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.434s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:43:53 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-3b261d88-3128-49e1-8077-32709e4b28ab tempest-AttachVolumeNegativeTest-652039892 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-39961515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=676aee41-6692-408d-9c94-92c2698e6004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a05d56cebf4a648f8e1448c266b3a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:43:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:43:49Z,use_quota=True,user_id='601cfe954e21466cb2aa683fe69a2b53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:43:53 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-3b261d88-3128-49e1-8077-32709e4b28ab tempest-AttachVolumeNegativeTest-652039892 None] Creating volume 676aee41-6692-408d-9c94-92c2698e6004 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:43:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-3b261d88-3128-49e1-8077-32709e4b28ab tempest-AttachVolumeNegativeTest-652039892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:43:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-3b261d88-3128-49e1-8077-32709e4b28ab tempest-AttachVolumeNegativeTest-652039892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:43:53 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-3b261d88-3128-49e1-8077-32709e4b28ab tempest-AttachVolumeNegativeTest-652039892 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:43:53 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-3b261d88-3128-49e1-8077-32709e4b28ab tempest-AttachVolumeNegativeTest-652039892 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:43:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-3b261d88-3128-49e1-8077-32709e4b28ab tempest-AttachVolumeNegativeTest-652039892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:43:53 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-3b261d88-3128-49e1-8077-32709e4b28ab tempest-AttachVolumeNegativeTest-652039892 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:43:53 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-3b261d88-3128-49e1-8077-32709e4b28ab tempest-AttachVolumeNegativeTest-652039892 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:43:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-3b261d88-3128-49e1-8077-32709e4b28ab tempest-AttachVolumeNegativeTest-652039892 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-676aee41-6692-408d-9c94-92c2698e6004 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:53 devstack quobyte-client[83193]: System call of process 91786 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:43:53 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=45, name=volume-676aee41-6692-408d-9c94-92c2698e6004, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0018c85a-1457-4c79-8751-223ebbd4c92a tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c76fdce-6e74-490a-b679-adbbd4deb284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1178175718',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e9b5297-bd92-4ec7-bea9-e6f899f77824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c8736886f484443ac00436dc0a1ddbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:43:51Z,use_quota=True,user_id='229e992549654633a4fba8fa52942967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0018c85a-1457-4c79-8751-223ebbd4c92a tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5e6e242-399a-410a-a9c4-903ccea1f535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0018c85a-1457-4c79-8751-223ebbd4c92a tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5e6e242-399a-410a-a9c4-903ccea1f535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0018c85a-1457-4c79-8751-223ebbd4c92a tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (247700e1-135b-4ddb-b2cf-44c2f63887a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0018c85a-1457-4c79-8751-223ebbd4c92a tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (247700e1-135b-4ddb-b2cf-44c2f63887a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e9b5297-bd92-4ec7-bea9-e6f899f77824', 'volume_name': 'volume-6e9b5297-bd92-4ec7-bea9-e6f899f77824', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0018c85a-1457-4c79-8751-223ebbd4c92a tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0a4856a-75fe-4626-ba26-6d184c70fb54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0018c85a-1457-4c79-8751-223ebbd4c92a tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0a4856a-75fe-4626-ba26-6d184c70fb54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0018c85a-1457-4c79-8751-223ebbd4c92a tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0fabb52-3f4e-467b-85dc-ec22d6126aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:54 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-0018c85a-1457-4c79-8751-223ebbd4c92a tempest-CreateVolumesFromImageTest-217997605 None] Volume 6e9b5297-bd92-4ec7-bea9-e6f899f77824: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e9b5297-bd92-4ec7-bea9-e6f899f77824', 'volume_size': 1}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0018c85a-1457-4c79-8751-223ebbd4c92a tempest-CreateVolumesFromImageTest-217997605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:43:54 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-c9da2f76-24ef-4f0c-b13b-82e4781e6db2 tempest-CreateVolumesFromImageTest-217997605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9da2f76-24ef-4f0c-b13b-82e4781e6db2 tempest-CreateVolumesFromImageTest-217997605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c9da2f76-24ef-4f0c-b13b-82e4781e6db2 tempest-CreateVolumesFromImageTest-217997605 None] Flow 'volume_create_manager' (bd24bfd5-6232-4664-a538-fc56a7717696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c9da2f76-24ef-4f0c-b13b-82e4781e6db2 tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2a17dc-7817-4eff-bbcd-40674e2078d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:54 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-db80008c-16b2-4cea-ad6b-3e14bcc85516 tempest-CreateVolumesFromImageTest-217997605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-db80008c-16b2-4cea-ad6b-3e14bcc85516 tempest-CreateVolumesFromImageTest-217997605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-db80008c-16b2-4cea-ad6b-3e14bcc85516 tempest-CreateVolumesFromImageTest-217997605 None] Flow 'volume_create_manager' (c778f298-3886-45a5-8f2b-81b492e6d6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-db80008c-16b2-4cea-ad6b-3e14bcc85516 tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b55af8ab-d247-40b7-bdd4-c2d955c91ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:UPDATE=52,cinder:SELECT=40,cinder:DELETE=5,cinder:INSERT=7 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-db80008c-16b2-4cea-ad6b-3e14bcc85516 tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b55af8ab-d247-40b7-bdd4-c2d955c91ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:43:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1226513737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d134a31c-1680-4d36-93f7-a801d10a50f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c8736886f484443ac00436dc0a1ddbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:43:50Z,use_quota=True,user_id='229e992549654633a4fba8fa52942967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-db80008c-16b2-4cea-ad6b-3e14bcc85516 tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (987bd74e-9aa6-4255-99ac-fbe46e26b03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-db80008c-16b2-4cea-ad6b-3e14bcc85516 tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (987bd74e-9aa6-4255-99ac-fbe46e26b03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-db80008c-16b2-4cea-ad6b-3e14bcc85516 tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a82655e1-2194-463a-8bc3-dc848e1ff133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-db80008c-16b2-4cea-ad6b-3e14bcc85516 tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a82655e1-2194-463a-8bc3-dc848e1ff133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd134a31c-1680-4d36-93f7-a801d10a50f3', 'volume_name': 'volume-d134a31c-1680-4d36-93f7-a801d10a50f3', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-db80008c-16b2-4cea-ad6b-3e14bcc85516 tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a3a049b-9e8d-450d-b451-dc21d25f2dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-db80008c-16b2-4cea-ad6b-3e14bcc85516 tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a3a049b-9e8d-450d-b451-dc21d25f2dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-db80008c-16b2-4cea-ad6b-3e14bcc85516 tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa4eca93-390f-4724-8f42-e03d67108288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:54 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-db80008c-16b2-4cea-ad6b-3e14bcc85516 tempest-CreateVolumesFromImageTest-217997605 None] Volume d134a31c-1680-4d36-93f7-a801d10a50f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d134a31c-1680-4d36-93f7-a801d10a50f3', 'volume_size': 1}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-db80008c-16b2-4cea-ad6b-3e14bcc85516 tempest-CreateVolumesFromImageTest-217997605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=43,cinder:UPDATE=36,cinder:INSERT=13,cinder:DELETE=2 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-a4b944f8-da28-456e-b10f-1330ffc0dd22 tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (718beb45-bdaf-4112-9259-265f82a0b93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-962007278',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=466d8d9f-35d7-4832-91e7-60056a664795,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c8736886f484443ac00436dc0a1ddbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:43:52Z,use_quota=True,user_id='229e992549654633a4fba8fa52942967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-a4b944f8-da28-456e-b10f-1330ffc0dd22 tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6afee0ab-02a2-4865-835a-aff59ee80822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-a4b944f8-da28-456e-b10f-1330ffc0dd22 tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6afee0ab-02a2-4865-835a-aff59ee80822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-a4b944f8-da28-456e-b10f-1330ffc0dd22 tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e97e7d76-338b-401c-b35c-b10ff597d4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-a4b944f8-da28-456e-b10f-1330ffc0dd22 tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e97e7d76-338b-401c-b35c-b10ff597d4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '466d8d9f-35d7-4832-91e7-60056a664795', 'volume_name': 'volume-466d8d9f-35d7-4832-91e7-60056a664795', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-a4b944f8-da28-456e-b10f-1330ffc0dd22 tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fccf04e1-679d-4972-9cbf-ce9935d7548f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-a4b944f8-da28-456e-b10f-1330ffc0dd22 tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fccf04e1-679d-4972-9cbf-ce9935d7548f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-a4b944f8-da28-456e-b10f-1330ffc0dd22 tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (283ab384-55c6-48ab-9895-4ab54f88f6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:54 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-a4b944f8-da28-456e-b10f-1330ffc0dd22 tempest-CreateVolumesFromImageTest-217997605 None] Volume 466d8d9f-35d7-4832-91e7-60056a664795: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-466d8d9f-35d7-4832-91e7-60056a664795', 'volume_size': 1}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a4b944f8-da28-456e-b10f-1330ffc0dd22 tempest-CreateVolumesFromImageTest-217997605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c9da2f76-24ef-4f0c-b13b-82e4781e6db2 tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2a17dc-7817-4eff-bbcd-40674e2078d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1994855955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff515cc9-e31b-4540-9ec0-124d0efd645a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c8736886f484443ac00436dc0a1ddbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:43:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:43:49Z,use_quota=True,user_id='229e992549654633a4fba8fa52942967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c9da2f76-24ef-4f0c-b13b-82e4781e6db2 tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a04e47a8-c75b-44d3-846a-856467857dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c9da2f76-24ef-4f0c-b13b-82e4781e6db2 tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a04e47a8-c75b-44d3-846a-856467857dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c9da2f76-24ef-4f0c-b13b-82e4781e6db2 tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16a95ca2-b80c-4222-b090-72197785881d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c9da2f76-24ef-4f0c-b13b-82e4781e6db2 tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16a95ca2-b80c-4222-b090-72197785881d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff515cc9-e31b-4540-9ec0-124d0efd645a', 'volume_name': 'volume-ff515cc9-e31b-4540-9ec0-124d0efd645a', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c9da2f76-24ef-4f0c-b13b-82e4781e6db2 tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49f84ff0-69c3-472f-82ac-ab585a9715d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c9da2f76-24ef-4f0c-b13b-82e4781e6db2 tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49f84ff0-69c3-472f-82ac-ab585a9715d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c9da2f76-24ef-4f0c-b13b-82e4781e6db2 tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6b5906b-941e-4b0a-ac49-0f2cccc4c4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:54 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-c9da2f76-24ef-4f0c-b13b-82e4781e6db2 tempest-CreateVolumesFromImageTest-217997605 None] Volume ff515cc9-e31b-4540-9ec0-124d0efd645a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff515cc9-e31b-4540-9ec0-124d0efd645a', 'volume_size': 1}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-c9da2f76-24ef-4f0c-b13b-82e4781e6db2 tempest-CreateVolumesFromImageTest-217997605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-3b261d88-3128-49e1-8077-32709e4b28ab tempest-AttachVolumeNegativeTest-652039892 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-676aee41-6692-408d-9c94-92c2698e6004 1073741824" returned: 0 in 0.972s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-3b261d88-3128-49e1-8077-32709e4b28ab tempest-AttachVolumeNegativeTest-652039892 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-676aee41-6692-408d-9c94-92c2698e6004 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-3b261d88-3128-49e1-8077-32709e4b28ab tempest-AttachVolumeNegativeTest-652039892 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-676aee41-6692-408d-9c94-92c2698e6004" returned: 0 in 0.204s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-3b261d88-3128-49e1-8077-32709e4b28ab tempest-AttachVolumeNegativeTest-652039892 None] <== create_volume: return (1231ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-3b261d88-3128-49e1-8077-32709e4b28ab tempest-AttachVolumeNegativeTest-652039892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0018c85a-1457-4c79-8751-223ebbd4c92a tempest-CreateVolumesFromImageTest-217997605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.818s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-0018c85a-1457-4c79-8751-223ebbd4c92a tempest-CreateVolumesFromImageTest-217997605 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1178175718',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e9b5297-bd92-4ec7-bea9-e6f899f77824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c8736886f484443ac00436dc0a1ddbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:43:51Z,use_quota=True,user_id='229e992549654633a4fba8fa52942967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-0018c85a-1457-4c79-8751-223ebbd4c92a tempest-CreateVolumesFromImageTest-217997605 None] Creating volume 6e9b5297-bd92-4ec7-bea9-e6f899f77824 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0018c85a-1457-4c79-8751-223ebbd4c92a tempest-CreateVolumesFromImageTest-217997605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0018c85a-1457-4c79-8751-223ebbd4c92a tempest-CreateVolumesFromImageTest-217997605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-0018c85a-1457-4c79-8751-223ebbd4c92a tempest-CreateVolumesFromImageTest-217997605 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-0018c85a-1457-4c79-8751-223ebbd4c92a tempest-CreateVolumesFromImageTest-217997605 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0018c85a-1457-4c79-8751-223ebbd4c92a tempest-CreateVolumesFromImageTest-217997605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-0018c85a-1457-4c79-8751-223ebbd4c92a tempest-CreateVolumesFromImageTest-217997605 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:43:54 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-0018c85a-1457-4c79-8751-223ebbd4c92a tempest-CreateVolumesFromImageTest-217997605 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:43:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0018c85a-1457-4c79-8751-223ebbd4c92a tempest-CreateVolumesFromImageTest-217997605 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-6e9b5297-bd92-4ec7-bea9-e6f899f77824 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:55 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=46, name=volume-6e9b5297-bd92-4ec7-bea9-e6f899f77824, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:43:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0018c85a-1457-4c79-8751-223ebbd4c92a tempest-CreateVolumesFromImageTest-217997605 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-6e9b5297-bd92-4ec7-bea9-e6f899f77824 1073741824" returned: 0 in 0.327s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0018c85a-1457-4c79-8751-223ebbd4c92a tempest-CreateVolumesFromImageTest-217997605 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-6e9b5297-bd92-4ec7-bea9-e6f899f77824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0018c85a-1457-4c79-8751-223ebbd4c92a tempest-CreateVolumesFromImageTest-217997605 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-6e9b5297-bd92-4ec7-bea9-e6f899f77824" returned: 0 in 0.083s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:55 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-0018c85a-1457-4c79-8751-223ebbd4c92a tempest-CreateVolumesFromImageTest-217997605 None] <== create_volume: return (482ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:43:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0018c85a-1457-4c79-8751-223ebbd4c92a tempest-CreateVolumesFromImageTest-217997605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.507s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:43:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-db80008c-16b2-4cea-ad6b-3e14bcc85516 tempest-CreateVolumesFromImageTest-217997605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.046s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:43:55 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-db80008c-16b2-4cea-ad6b-3e14bcc85516 tempest-CreateVolumesFromImageTest-217997605 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:43:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1226513737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d134a31c-1680-4d36-93f7-a801d10a50f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c8736886f484443ac00436dc0a1ddbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:43:50Z,use_quota=True,user_id='229e992549654633a4fba8fa52942967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:43:55 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-db80008c-16b2-4cea-ad6b-3e14bcc85516 tempest-CreateVolumesFromImageTest-217997605 None] Creating volume d134a31c-1680-4d36-93f7-a801d10a50f3 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:43:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-db80008c-16b2-4cea-ad6b-3e14bcc85516 tempest-CreateVolumesFromImageTest-217997605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:43:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-db80008c-16b2-4cea-ad6b-3e14bcc85516 tempest-CreateVolumesFromImageTest-217997605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:43:55 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-db80008c-16b2-4cea-ad6b-3e14bcc85516 tempest-CreateVolumesFromImageTest-217997605 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:43:55 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-db80008c-16b2-4cea-ad6b-3e14bcc85516 tempest-CreateVolumesFromImageTest-217997605 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:43:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-db80008c-16b2-4cea-ad6b-3e14bcc85516 tempest-CreateVolumesFromImageTest-217997605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:43:55 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-db80008c-16b2-4cea-ad6b-3e14bcc85516 tempest-CreateVolumesFromImageTest-217997605 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:43:55 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-db80008c-16b2-4cea-ad6b-3e14bcc85516 tempest-CreateVolumesFromImageTest-217997605 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:43:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-db80008c-16b2-4cea-ad6b-3e14bcc85516 tempest-CreateVolumesFromImageTest-217997605 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d134a31c-1680-4d36-93f7-a801d10a50f3 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:55 devstack quobyte-client[83193]: System call of process 91801 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:43:55 devstack quobyte-client[83193]: System call of process 91801 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:43:55 devstack quobyte-client[83193]: System call of process 91801 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:43:55 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=47, name=volume-d134a31c-1680-4d36-93f7-a801d10a50f3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:43:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-db80008c-16b2-4cea-ad6b-3e14bcc85516 tempest-CreateVolumesFromImageTest-217997605 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d134a31c-1680-4d36-93f7-a801d10a50f3 1073741824" returned: 0 in 0.306s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-db80008c-16b2-4cea-ad6b-3e14bcc85516 tempest-CreateVolumesFromImageTest-217997605 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d134a31c-1680-4d36-93f7-a801d10a50f3 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:56 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-db80008c-16b2-4cea-ad6b-3e14bcc85516 tempest-CreateVolumesFromImageTest-217997605 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d134a31c-1680-4d36-93f7-a801d10a50f3" returned: 0 in 0.095s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:56 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-db80008c-16b2-4cea-ad6b-3e14bcc85516 tempest-CreateVolumesFromImageTest-217997605 None] <== create_volume: return (470ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:43:56 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-db80008c-16b2-4cea-ad6b-3e14bcc85516 tempest-CreateVolumesFromImageTest-217997605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.493s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:43:56 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a4b944f8-da28-456e-b10f-1330ffc0dd22 tempest-CreateVolumesFromImageTest-217997605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.616s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:43:56 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a4b944f8-da28-456e-b10f-1330ffc0dd22 tempest-CreateVolumesFromImageTest-217997605 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-962007278',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=466d8d9f-35d7-4832-91e7-60056a664795,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c8736886f484443ac00436dc0a1ddbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:43:52Z,use_quota=True,user_id='229e992549654633a4fba8fa52942967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:43:56 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-a4b944f8-da28-456e-b10f-1330ffc0dd22 tempest-CreateVolumesFromImageTest-217997605 None] Creating volume 466d8d9f-35d7-4832-91e7-60056a664795 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:43:56 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a4b944f8-da28-456e-b10f-1330ffc0dd22 tempest-CreateVolumesFromImageTest-217997605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:43:56 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a4b944f8-da28-456e-b10f-1330ffc0dd22 tempest-CreateVolumesFromImageTest-217997605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:43:56 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a4b944f8-da28-456e-b10f-1330ffc0dd22 tempest-CreateVolumesFromImageTest-217997605 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:43:56 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a4b944f8-da28-456e-b10f-1330ffc0dd22 tempest-CreateVolumesFromImageTest-217997605 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:43:56 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a4b944f8-da28-456e-b10f-1330ffc0dd22 tempest-CreateVolumesFromImageTest-217997605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:43:56 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a4b944f8-da28-456e-b10f-1330ffc0dd22 tempest-CreateVolumesFromImageTest-217997605 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:43:56 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-a4b944f8-da28-456e-b10f-1330ffc0dd22 tempest-CreateVolumesFromImageTest-217997605 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:43:56 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a4b944f8-da28-456e-b10f-1330ffc0dd22 tempest-CreateVolumesFromImageTest-217997605 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-466d8d9f-35d7-4832-91e7-60056a664795 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:56 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=48, name=volume-466d8d9f-35d7-4832-91e7-60056a664795, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:43:56 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0018c85a-1457-4c79-8751-223ebbd4c92a tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0fabb52-3f4e-467b-85dc-ec22d6126aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e9b5297-bd92-4ec7-bea9-e6f899f77824', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:56 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0018c85a-1457-4c79-8751-223ebbd4c92a tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2799a45-751c-4b34-8422-120b9ff77c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:56 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3b261d88-3128-49e1-8077-32709e4b28ab tempest-AttachVolumeNegativeTest-652039892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02952406-b902-4438-baa7-97450116399f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-676aee41-6692-408d-9c94-92c2698e6004', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:56 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3b261d88-3128-49e1-8077-32709e4b28ab tempest-AttachVolumeNegativeTest-652039892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f2daa10-5ad7-4880-90b6-2921e5c7b050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:56 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-db80008c-16b2-4cea-ad6b-3e14bcc85516 tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa4eca93-390f-4724-8f42-e03d67108288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d134a31c-1680-4d36-93f7-a801d10a50f3', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:56 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-db80008c-16b2-4cea-ad6b-3e14bcc85516 tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d5d13dc-bdbf-46de-ba44-652ecb164893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:56 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3fb689f2-21a7-4593-a293-dd364033ecac tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f067f747-0310-47c3-ad7e-8a244cff9898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bffa85a2-c61a-44d1-b5b7-dc93fe1d1a06', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:56 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3fb689f2-21a7-4593-a293-dd364033ecac tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5299d954-06cf-44a2-9f45-b0acd1da78f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:56 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a4b944f8-da28-456e-b10f-1330ffc0dd22 tempest-CreateVolumesFromImageTest-217997605 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-466d8d9f-35d7-4832-91e7-60056a664795 1073741824" returned: 0 in 0.712s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:56 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a4b944f8-da28-456e-b10f-1330ffc0dd22 tempest-CreateVolumesFromImageTest-217997605 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-466d8d9f-35d7-4832-91e7-60056a664795 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:57 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-0018c85a-1457-4c79-8751-223ebbd4c92a tempest-CreateVolumesFromImageTest-217997605 None] Volume volume-6e9b5297-bd92-4ec7-bea9-e6f899f77824 (6e9b5297-bd92-4ec7-bea9-e6f899f77824): created successfully
Sep 18 11:43:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0018c85a-1457-4c79-8751-223ebbd4c92a tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2799a45-751c-4b34-8422-120b9ff77c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0018c85a-1457-4c79-8751-223ebbd4c92a tempest-CreateVolumesFromImageTest-217997605 None] Flow 'volume_create_manager' (255811ec-23c5-4ab3-b6a8-012b39022551) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:43:57 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-3fb689f2-21a7-4593-a293-dd364033ecac tempest-CreateVolumesFromImageTest-217997605 None] Volume volume-bffa85a2-c61a-44d1-b5b7-dc93fe1d1a06 (bffa85a2-c61a-44d1-b5b7-dc93fe1d1a06): created successfully
Sep 18 11:43:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3fb689f2-21a7-4593-a293-dd364033ecac tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5299d954-06cf-44a2-9f45-b0acd1da78f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3fb689f2-21a7-4593-a293-dd364033ecac tempest-CreateVolumesFromImageTest-217997605 None] Flow 'volume_create_manager' (ad12a6d9-2508-424b-937d-55ede4928f2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:43:57 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-3b261d88-3128-49e1-8077-32709e4b28ab tempest-AttachVolumeNegativeTest-652039892 None] Volume volume-676aee41-6692-408d-9c94-92c2698e6004 (676aee41-6692-408d-9c94-92c2698e6004): created successfully
Sep 18 11:43:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3b261d88-3128-49e1-8077-32709e4b28ab tempest-AttachVolumeNegativeTest-652039892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f2daa10-5ad7-4880-90b6-2921e5c7b050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3b261d88-3128-49e1-8077-32709e4b28ab tempest-AttachVolumeNegativeTest-652039892 None] Flow 'volume_create_manager' (581c6a87-1389-4746-866a-5abaaeb7d5d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:43:57 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-0018c85a-1457-4c79-8751-223ebbd4c92a tempest-CreateVolumesFromImageTest-217997605 None] Created volume successfully.
Sep 18 11:43:57 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-db80008c-16b2-4cea-ad6b-3e14bcc85516 tempest-CreateVolumesFromImageTest-217997605 None] Volume volume-d134a31c-1680-4d36-93f7-a801d10a50f3 (d134a31c-1680-4d36-93f7-a801d10a50f3): created successfully
Sep 18 11:43:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-db80008c-16b2-4cea-ad6b-3e14bcc85516 tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d5d13dc-bdbf-46de-ba44-652ecb164893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-db80008c-16b2-4cea-ad6b-3e14bcc85516 tempest-CreateVolumesFromImageTest-217997605 None] Flow 'volume_create_manager' (c778f298-3886-45a5-8f2b-81b492e6d6fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:43:57 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-3b261d88-3128-49e1-8077-32709e4b28ab tempest-AttachVolumeNegativeTest-652039892 None] Created volume successfully.
Sep 18 11:43:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a4b944f8-da28-456e-b10f-1330ffc0dd22 tempest-CreateVolumesFromImageTest-217997605 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-466d8d9f-35d7-4832-91e7-60056a664795" returned: 0 in 0.606s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:57 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a4b944f8-da28-456e-b10f-1330ffc0dd22 tempest-CreateVolumesFromImageTest-217997605 None] <== create_volume: return (1364ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:43:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a4b944f8-da28-456e-b10f-1330ffc0dd22 tempest-CreateVolumesFromImageTest-217997605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:43:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-c9da2f76-24ef-4f0c-b13b-82e4781e6db2 tempest-CreateVolumesFromImageTest-217997605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.977s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:43:57 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-c9da2f76-24ef-4f0c-b13b-82e4781e6db2 tempest-CreateVolumesFromImageTest-217997605 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1994855955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff515cc9-e31b-4540-9ec0-124d0efd645a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c8736886f484443ac00436dc0a1ddbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:43:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:43:49Z,use_quota=True,user_id='229e992549654633a4fba8fa52942967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:43:57 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-c9da2f76-24ef-4f0c-b13b-82e4781e6db2 tempest-CreateVolumesFromImageTest-217997605 None] Creating volume ff515cc9-e31b-4540-9ec0-124d0efd645a {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:43:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-c9da2f76-24ef-4f0c-b13b-82e4781e6db2 tempest-CreateVolumesFromImageTest-217997605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:43:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-c9da2f76-24ef-4f0c-b13b-82e4781e6db2 tempest-CreateVolumesFromImageTest-217997605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:43:57 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-c9da2f76-24ef-4f0c-b13b-82e4781e6db2 tempest-CreateVolumesFromImageTest-217997605 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:43:57 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-c9da2f76-24ef-4f0c-b13b-82e4781e6db2 tempest-CreateVolumesFromImageTest-217997605 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:43:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-c9da2f76-24ef-4f0c-b13b-82e4781e6db2 tempest-CreateVolumesFromImageTest-217997605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:43:57 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-c9da2f76-24ef-4f0c-b13b-82e4781e6db2 tempest-CreateVolumesFromImageTest-217997605 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:43:57 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-c9da2f76-24ef-4f0c-b13b-82e4781e6db2 tempest-CreateVolumesFromImageTest-217997605 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:43:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c9da2f76-24ef-4f0c-b13b-82e4781e6db2 tempest-CreateVolumesFromImageTest-217997605 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-ff515cc9-e31b-4540-9ec0-124d0efd645a 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:57 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-db80008c-16b2-4cea-ad6b-3e14bcc85516 tempest-CreateVolumesFromImageTest-217997605 None] Created volume successfully.
Sep 18 11:43:57 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=49, name=volume-ff515cc9-e31b-4540-9ec0-124d0efd645a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:43:58 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-3fb689f2-21a7-4593-a293-dd364033ecac tempest-CreateVolumesFromImageTest-217997605 None] Created volume successfully.
Sep 18 11:43:58 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-a4b944f8-da28-456e-b10f-1330ffc0dd22 tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (283ab384-55c6-48ab-9895-4ab54f88f6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-466d8d9f-35d7-4832-91e7-60056a664795', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:58 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-a4b944f8-da28-456e-b10f-1330ffc0dd22 tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0f4ec3c-80b1-4448-a72b-797a677811bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:58 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-a4b944f8-da28-456e-b10f-1330ffc0dd22 tempest-CreateVolumesFromImageTest-217997605 None] Volume volume-466d8d9f-35d7-4832-91e7-60056a664795 (466d8d9f-35d7-4832-91e7-60056a664795): created successfully
Sep 18 11:43:58 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-a4b944f8-da28-456e-b10f-1330ffc0dd22 tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0f4ec3c-80b1-4448-a72b-797a677811bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:58 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-a4b944f8-da28-456e-b10f-1330ffc0dd22 tempest-CreateVolumesFromImageTest-217997605 None] Flow 'volume_create_manager' (2967818d-e266-4fba-977d-dd09b8bce5d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:43:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c9da2f76-24ef-4f0c-b13b-82e4781e6db2 tempest-CreateVolumesFromImageTest-217997605 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-ff515cc9-e31b-4540-9ec0-124d0efd645a 1073741824" returned: 0 in 0.650s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c9da2f76-24ef-4f0c-b13b-82e4781e6db2 tempest-CreateVolumesFromImageTest-217997605 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-ff515cc9-e31b-4540-9ec0-124d0efd645a {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:43:58 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-a4b944f8-da28-456e-b10f-1330ffc0dd22 tempest-CreateVolumesFromImageTest-217997605 None] Created volume successfully.
Sep 18 11:43:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c9da2f76-24ef-4f0c-b13b-82e4781e6db2 tempest-CreateVolumesFromImageTest-217997605 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-ff515cc9-e31b-4540-9ec0-124d0efd645a" returned: 0 in 0.481s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:43:58 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-c9da2f76-24ef-4f0c-b13b-82e4781e6db2 tempest-CreateVolumesFromImageTest-217997605 None] <== create_volume: return (1163ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:43:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-c9da2f76-24ef-4f0c-b13b-82e4781e6db2 tempest-CreateVolumesFromImageTest-217997605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:43:58 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c9da2f76-24ef-4f0c-b13b-82e4781e6db2 tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6b5906b-941e-4b0a-ac49-0f2cccc4c4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff515cc9-e31b-4540-9ec0-124d0efd645a', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:58 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c9da2f76-24ef-4f0c-b13b-82e4781e6db2 tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55edbbac-c7d7-467e-9a3a-d448d8efcf69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:43:59 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-c9da2f76-24ef-4f0c-b13b-82e4781e6db2 tempest-CreateVolumesFromImageTest-217997605 None] Volume volume-ff515cc9-e31b-4540-9ec0-124d0efd645a (ff515cc9-e31b-4540-9ec0-124d0efd645a): created successfully
Sep 18 11:43:59 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c9da2f76-24ef-4f0c-b13b-82e4781e6db2 tempest-CreateVolumesFromImageTest-217997605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55edbbac-c7d7-467e-9a3a-d448d8efcf69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:43:59 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c9da2f76-24ef-4f0c-b13b-82e4781e6db2 tempest-CreateVolumesFromImageTest-217997605 None] Flow 'volume_create_manager' (bd24bfd5-6232-4664-a538-fc56a7717696) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:43:59 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-c9da2f76-24ef-4f0c-b13b-82e4781e6db2 tempest-CreateVolumesFromImageTest-217997605 None] Created volume successfully.
Sep 18 11:43:59 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-9931ada4-e94f-40cd-b43b-46fbfe513729 tempest-CreateVolumesFromImageTest-217997605 None] Acquiring lock "cinder-466d8d9f-35d7-4832-91e7-60056a664795-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:43:59 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-9931ada4-e94f-40cd-b43b-46fbfe513729 tempest-CreateVolumesFromImageTest-217997605 None] Lock "cinder-466d8d9f-35d7-4832-91e7-60056a664795-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:44:00 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-9931ada4-e94f-40cd-b43b-46fbfe513729 tempest-CreateVolumesFromImageTest-217997605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:44:00 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-9931ada4-e94f-40cd-b43b-46fbfe513729 tempest-CreateVolumesFromImageTest-217997605 None] Acquiring lock "cinder-quobyte-466d8d9f-35d7-4832-91e7-60056a664795" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:44:00 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-9931ada4-e94f-40cd-b43b-46fbfe513729 tempest-CreateVolumesFromImageTest-217997605 None] Lock "cinder-quobyte-466d8d9f-35d7-4832-91e7-60056a664795" acquired by "delete_volume" :: waited 0.015s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:44:00 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c388e8-0b81-4ddd-b4e9-7aec9a5fa75c]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:44:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9931ada4-e94f-40cd-b43b-46fbfe513729 tempest-CreateVolumesFromImageTest-217997605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-466d8d9f-35d7-4832-91e7-60056a664795 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:44:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9931ada4-e94f-40cd-b43b-46fbfe513729 tempest-CreateVolumesFromImageTest-217997605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-466d8d9f-35d7-4832-91e7-60056a664795" returned: 0 in 0.499s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:44:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9931ada4-e94f-40cd-b43b-46fbfe513729 tempest-CreateVolumesFromImageTest-217997605 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-466d8d9f-35d7-4832-91e7-60056a664795 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:44:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9931ada4-e94f-40cd-b43b-46fbfe513729 tempest-CreateVolumesFromImageTest-217997605 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-466d8d9f-35d7-4832-91e7-60056a664795" returned: 0 in 0.114s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:44:00 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-9931ada4-e94f-40cd-b43b-46fbfe513729 tempest-CreateVolumesFromImageTest-217997605 None] Lock "cinder-quobyte-466d8d9f-35d7-4832-91e7-60056a664795" released by "delete_volume" :: held 0.838s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:44:01 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-9931ada4-e94f-40cd-b43b-46fbfe513729 tempest-CreateVolumesFromImageTest-217997605 None] Created reservations ['469e25d5-3de2-4d21-b757-74cc3b3a4812', '2bd95f46-44d3-4d57-a0ff-ed6f02b27186', 'b14c9257-9881-4496-8a04-6395ecd59a43', 'a85f1b60-0e63-443d-a4a9-3af7225dff55'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:44:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-9931ada4-e94f-40cd-b43b-46fbfe513729 tempest-CreateVolumesFromImageTest-217997605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:44:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-9931ada4-e94f-40cd-b43b-46fbfe513729 tempest-CreateVolumesFromImageTest-217997605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:44:01 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-9931ada4-e94f-40cd-b43b-46fbfe513729 tempest-CreateVolumesFromImageTest-217997605 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:44:01 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-9931ada4-e94f-40cd-b43b-46fbfe513729 tempest-CreateVolumesFromImageTest-217997605 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:44:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-9931ada4-e94f-40cd-b43b-46fbfe513729 tempest-CreateVolumesFromImageTest-217997605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:44:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9931ada4-e94f-40cd-b43b-46fbfe513729 tempest-CreateVolumesFromImageTest-217997605 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:44:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9931ada4-e94f-40cd-b43b-46fbfe513729 tempest-CreateVolumesFromImageTest-217997605 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.127s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:44:01 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-9931ada4-e94f-40cd-b43b-46fbfe513729 tempest-CreateVolumesFromImageTest-217997605 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:44:01 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-9931ada4-e94f-40cd-b43b-46fbfe513729 tempest-CreateVolumesFromImageTest-217997605 None] Deleted volume successfully.
Sep 18 11:44:02 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-9931ada4-e94f-40cd-b43b-46fbfe513729 tempest-CreateVolumesFromImageTest-217997605 None] Lock "cinder-466d8d9f-35d7-4832-91e7-60056a664795-delete_volume" released by "delete_volume" :: held 2.219s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:44:02 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-102ab7ee-c646-45bc-b58f-f963ad772a1d tempest-CreateVolumesFromImageTest-217997605 None] Acquiring lock "cinder-6e9b5297-bd92-4ec7-bea9-e6f899f77824-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:44:02 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-102ab7ee-c646-45bc-b58f-f963ad772a1d tempest-CreateVolumesFromImageTest-217997605 None] Lock "cinder-6e9b5297-bd92-4ec7-bea9-e6f899f77824-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:44:02 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-102ab7ee-c646-45bc-b58f-f963ad772a1d tempest-CreateVolumesFromImageTest-217997605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:44:02 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-102ab7ee-c646-45bc-b58f-f963ad772a1d tempest-CreateVolumesFromImageTest-217997605 None] Acquiring lock "cinder-quobyte-6e9b5297-bd92-4ec7-bea9-e6f899f77824" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:44:02 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-102ab7ee-c646-45bc-b58f-f963ad772a1d tempest-CreateVolumesFromImageTest-217997605 None] Lock "cinder-quobyte-6e9b5297-bd92-4ec7-bea9-e6f899f77824" acquired by "delete_volume" :: waited 0.042s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:44:02 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7681cbb9-858e-4f97-aac4-9fb305942bad]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:44:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-102ab7ee-c646-45bc-b58f-f963ad772a1d tempest-CreateVolumesFromImageTest-217997605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-6e9b5297-bd92-4ec7-bea9-e6f899f77824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:44:03 devstack quobyte-client[83193]: System call of process 91847 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:44:03 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-102ab7ee-c646-45bc-b58f-f963ad772a1d tempest-CreateVolumesFromImageTest-217997605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-6e9b5297-bd92-4ec7-bea9-e6f899f77824" returned: 0 in 0.808s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:44:03 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-102ab7ee-c646-45bc-b58f-f963ad772a1d tempest-CreateVolumesFromImageTest-217997605 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-6e9b5297-bd92-4ec7-bea9-e6f899f77824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:44:03 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-102ab7ee-c646-45bc-b58f-f963ad772a1d tempest-CreateVolumesFromImageTest-217997605 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-6e9b5297-bd92-4ec7-bea9-e6f899f77824" returned: 0 in 0.256s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:44:04 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-102ab7ee-c646-45bc-b58f-f963ad772a1d tempest-CreateVolumesFromImageTest-217997605 None] Lock "cinder-quobyte-6e9b5297-bd92-4ec7-bea9-e6f899f77824" released by "delete_volume" :: held 1.531s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:44:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-6472ed90-50fe-4efd-a4a2-20b94d7941ef req-6a50da61-c777-4e50-9359-b0557a4d922a tempest-AttachVolumeNegativeTest-652039892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:44:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-6472ed90-50fe-4efd-a4a2-20b94d7941ef req-6a50da61-c777-4e50-9359-b0557a4d922a tempest-AttachVolumeNegativeTest-652039892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:44:04 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb50de70-f5d7-4447-ba62-c2a537152aae]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:44:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-6472ed90-50fe-4efd-a4a2-20b94d7941ef req-6a50da61-c777-4e50-9359-b0557a4d922a tempest-AttachVolumeNegativeTest-652039892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-676aee41-6692-408d-9c94-92c2698e6004 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:44:04 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-102ab7ee-c646-45bc-b58f-f963ad772a1d tempest-CreateVolumesFromImageTest-217997605 None] Created reservations ['b0b09d03-f61f-4a59-9274-d11ff7cc356d', '88274bf8-52c9-495e-a083-3b5e5023789e', 'e8c1f6af-a529-40e5-a4bb-455e0eda02da', '54db2574-0ebb-4d5a-a1cc-1f9f88651802'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:44:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-6472ed90-50fe-4efd-a4a2-20b94d7941ef req-6a50da61-c777-4e50-9359-b0557a4d922a tempest-AttachVolumeNegativeTest-652039892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-676aee41-6692-408d-9c94-92c2698e6004" returned: 0 in 0.726s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:44:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-6472ed90-50fe-4efd-a4a2-20b94d7941ef req-6a50da61-c777-4e50-9359-b0557a4d922a tempest-AttachVolumeNegativeTest-652039892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.771s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:44:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-102ab7ee-c646-45bc-b58f-f963ad772a1d tempest-CreateVolumesFromImageTest-217997605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:44:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-102ab7ee-c646-45bc-b58f-f963ad772a1d tempest-CreateVolumesFromImageTest-217997605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:44:05 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-102ab7ee-c646-45bc-b58f-f963ad772a1d tempest-CreateVolumesFromImageTest-217997605 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:44:05 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-102ab7ee-c646-45bc-b58f-f963ad772a1d tempest-CreateVolumesFromImageTest-217997605 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:44:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-102ab7ee-c646-45bc-b58f-f963ad772a1d tempest-CreateVolumesFromImageTest-217997605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:44:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-102ab7ee-c646-45bc-b58f-f963ad772a1d tempest-CreateVolumesFromImageTest-217997605 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:44:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-102ab7ee-c646-45bc-b58f-f963ad772a1d tempest-CreateVolumesFromImageTest-217997605 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.386s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:44:05 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-102ab7ee-c646-45bc-b58f-f963ad772a1d tempest-CreateVolumesFromImageTest-217997605 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:44:05 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-102ab7ee-c646-45bc-b58f-f963ad772a1d tempest-CreateVolumesFromImageTest-217997605 None] Deleted volume successfully.
Sep 18 11:44:05 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-6472ed90-50fe-4efd-a4a2-20b94d7941ef req-6a50da61-c777-4e50-9359-b0557a4d922a tempest-AttachVolumeNegativeTest-652039892 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8', 'name': 'volume-676aee41-6692-408d-9c94-92c2698e6004', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '03d43142-6233-4bec-b1a4-c5615bfc7580', 'enforce_multipath': True} {{(pid=83176) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 11:44:05 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-6472ed90-50fe-4efd-a4a2-20b94d7941ef req-6a50da61-c777-4e50-9359-b0557a4d922a tempest-AttachVolumeNegativeTest-652039892 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:44:06 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-2f2acfcb-b567-435a-8029-d3cc0d561ef9 tempest-CreateVolumesFromImageTest-217997605 None] Acquiring lock "cinder-d134a31c-1680-4d36-93f7-a801d10a50f3-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:44:06 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-102ab7ee-c646-45bc-b58f-f963ad772a1d tempest-CreateVolumesFromImageTest-217997605 None] Lock "cinder-6e9b5297-bd92-4ec7-bea9-e6f899f77824-delete_volume" released by "delete_volume" :: held 3.991s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:44:06 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-2f2acfcb-b567-435a-8029-d3cc0d561ef9 tempest-CreateVolumesFromImageTest-217997605 None] Lock "cinder-d134a31c-1680-4d36-93f7-a801d10a50f3-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:44:06 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-2f2acfcb-b567-435a-8029-d3cc0d561ef9 tempest-CreateVolumesFromImageTest-217997605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:44:06 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-2f2acfcb-b567-435a-8029-d3cc0d561ef9 tempest-CreateVolumesFromImageTest-217997605 None] Acquiring lock "cinder-quobyte-d134a31c-1680-4d36-93f7-a801d10a50f3" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:44:06 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-2f2acfcb-b567-435a-8029-d3cc0d561ef9 tempest-CreateVolumesFromImageTest-217997605 None] Lock "cinder-quobyte-d134a31c-1680-4d36-93f7-a801d10a50f3" acquired by "delete_volume" :: waited 0.038s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:44:06 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-6472ed90-50fe-4efd-a4a2-20b94d7941ef req-6a50da61-c777-4e50-9359-b0557a4d922a tempest-AttachVolumeNegativeTest-652039892 None] attachment_update completed successfully.
Sep 18 11:44:06 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05931ef-70c4-4449-9476-debc9ce21769]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:44:06 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2f2acfcb-b567-435a-8029-d3cc0d561ef9 tempest-CreateVolumesFromImageTest-217997605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d134a31c-1680-4d36-93f7-a801d10a50f3 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:44:07 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2f2acfcb-b567-435a-8029-d3cc0d561ef9 tempest-CreateVolumesFromImageTest-217997605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d134a31c-1680-4d36-93f7-a801d10a50f3" returned: 0 in 0.978s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:44:07 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2f2acfcb-b567-435a-8029-d3cc0d561ef9 tempest-CreateVolumesFromImageTest-217997605 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d134a31c-1680-4d36-93f7-a801d10a50f3 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:44:07 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2f2acfcb-b567-435a-8029-d3cc0d561ef9 tempest-CreateVolumesFromImageTest-217997605 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d134a31c-1680-4d36-93f7-a801d10a50f3" returned: 0 in 0.178s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:44:08 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-2f2acfcb-b567-435a-8029-d3cc0d561ef9 tempest-CreateVolumesFromImageTest-217997605 None] Lock "cinder-quobyte-d134a31c-1680-4d36-93f7-a801d10a50f3" released by "delete_volume" :: held 1.449s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:44:08 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-2f2acfcb-b567-435a-8029-d3cc0d561ef9 tempest-CreateVolumesFromImageTest-217997605 None] Created reservations ['572e4ea5-41f6-4df9-95af-e6acd7aa84b1', 'b6435fae-c8d3-459b-88b7-0ff75ade700d', 'd4bc0848-d11e-457e-83b0-26e449faf4c9', 'efd8bb3a-7bb6-4d95-a2e0-11737efb998f'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:44:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-2f2acfcb-b567-435a-8029-d3cc0d561ef9 tempest-CreateVolumesFromImageTest-217997605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:44:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-2f2acfcb-b567-435a-8029-d3cc0d561ef9 tempest-CreateVolumesFromImageTest-217997605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:44:08 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-2f2acfcb-b567-435a-8029-d3cc0d561ef9 tempest-CreateVolumesFromImageTest-217997605 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:44:08 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-2f2acfcb-b567-435a-8029-d3cc0d561ef9 tempest-CreateVolumesFromImageTest-217997605 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:44:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-2f2acfcb-b567-435a-8029-d3cc0d561ef9 tempest-CreateVolumesFromImageTest-217997605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:44:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2f2acfcb-b567-435a-8029-d3cc0d561ef9 tempest-CreateVolumesFromImageTest-217997605 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:44:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2f2acfcb-b567-435a-8029-d3cc0d561ef9 tempest-CreateVolumesFromImageTest-217997605 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.231s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:44:08 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-2f2acfcb-b567-435a-8029-d3cc0d561ef9 tempest-CreateVolumesFromImageTest-217997605 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:44:09 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-a393a0c1-dd1e-48e4-9f5e-f385182eb421 tempest-CreateVolumesFromImageTest-217997605 None] Acquiring lock "cinder-ff515cc9-e31b-4540-9ec0-124d0efd645a-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:44:09 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-2f2acfcb-b567-435a-8029-d3cc0d561ef9 tempest-CreateVolumesFromImageTest-217997605 None] Deleted volume successfully.
Sep 18 11:44:09 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-a393a0c1-dd1e-48e4-9f5e-f385182eb421 tempest-CreateVolumesFromImageTest-217997605 None] Lock "cinder-ff515cc9-e31b-4540-9ec0-124d0efd645a-delete_volume" acquired by "delete_volume" :: waited 0.182s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:44:09 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-2f2acfcb-b567-435a-8029-d3cc0d561ef9 tempest-CreateVolumesFromImageTest-217997605 None] Lock "cinder-d134a31c-1680-4d36-93f7-a801d10a50f3-delete_volume" released by "delete_volume" :: held 2.859s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:44:09 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-a393a0c1-dd1e-48e4-9f5e-f385182eb421 tempest-CreateVolumesFromImageTest-217997605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:44:09 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-a393a0c1-dd1e-48e4-9f5e-f385182eb421 tempest-CreateVolumesFromImageTest-217997605 None] Acquiring lock "cinder-quobyte-ff515cc9-e31b-4540-9ec0-124d0efd645a" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:44:09 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-a393a0c1-dd1e-48e4-9f5e-f385182eb421 tempest-CreateVolumesFromImageTest-217997605 None] Lock "cinder-quobyte-ff515cc9-e31b-4540-9ec0-124d0efd645a" acquired by "delete_volume" :: waited 0.013s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:44:09 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[52967049-5fbd-49f1-b49f-6bbdcf6ccf68]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:44:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a393a0c1-dd1e-48e4-9f5e-f385182eb421 tempest-CreateVolumesFromImageTest-217997605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-ff515cc9-e31b-4540-9ec0-124d0efd645a {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:44:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a393a0c1-dd1e-48e4-9f5e-f385182eb421 tempest-CreateVolumesFromImageTest-217997605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-ff515cc9-e31b-4540-9ec0-124d0efd645a" returned: 0 in 1.037s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:44:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a393a0c1-dd1e-48e4-9f5e-f385182eb421 tempest-CreateVolumesFromImageTest-217997605 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-ff515cc9-e31b-4540-9ec0-124d0efd645a {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:44:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a393a0c1-dd1e-48e4-9f5e-f385182eb421 tempest-CreateVolumesFromImageTest-217997605 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-ff515cc9-e31b-4540-9ec0-124d0efd645a" returned: 0 in 0.191s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:44:10 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-a393a0c1-dd1e-48e4-9f5e-f385182eb421 tempest-CreateVolumesFromImageTest-217997605 None] Lock "cinder-quobyte-ff515cc9-e31b-4540-9ec0-124d0efd645a" released by "delete_volume" :: held 1.492s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:44:11 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-a393a0c1-dd1e-48e4-9f5e-f385182eb421 tempest-CreateVolumesFromImageTest-217997605 None] Created reservations ['28c0a39e-b74a-4883-b0b4-b046d50bf2ae', '10af56ae-0879-47d4-9937-ebc3db9edb3a', '41256a13-33f0-4223-a80c-684c022ce5bb', 'ac934e67-f7e5-4013-b105-beb984041411'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:44:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a393a0c1-dd1e-48e4-9f5e-f385182eb421 tempest-CreateVolumesFromImageTest-217997605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:44:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a393a0c1-dd1e-48e4-9f5e-f385182eb421 tempest-CreateVolumesFromImageTest-217997605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:44:12 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a393a0c1-dd1e-48e4-9f5e-f385182eb421 tempest-CreateVolumesFromImageTest-217997605 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:44:12 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a393a0c1-dd1e-48e4-9f5e-f385182eb421 tempest-CreateVolumesFromImageTest-217997605 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:44:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a393a0c1-dd1e-48e4-9f5e-f385182eb421 tempest-CreateVolumesFromImageTest-217997605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:44:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a393a0c1-dd1e-48e4-9f5e-f385182eb421 tempest-CreateVolumesFromImageTest-217997605 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:44:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a393a0c1-dd1e-48e4-9f5e-f385182eb421 tempest-CreateVolumesFromImageTest-217997605 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.141s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:44:12 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a393a0c1-dd1e-48e4-9f5e-f385182eb421 tempest-CreateVolumesFromImageTest-217997605 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:44:12 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-a393a0c1-dd1e-48e4-9f5e-f385182eb421 tempest-CreateVolumesFromImageTest-217997605 None] Deleted volume successfully.
Sep 18 11:44:12 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-a393a0c1-dd1e-48e4-9f5e-f385182eb421 tempest-CreateVolumesFromImageTest-217997605 None] Lock "cinder-ff515cc9-e31b-4540-9ec0-124d0efd645a-delete_volume" released by "delete_volume" :: held 3.669s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:44:13 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-58ddab32-a720-4aef-bbfe-6cc5ee37a571 tempest-CreateVolumesFromImageTest-217997605 None] Acquiring lock "cinder-bffa85a2-c61a-44d1-b5b7-dc93fe1d1a06-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:44:13 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-58ddab32-a720-4aef-bbfe-6cc5ee37a571 tempest-CreateVolumesFromImageTest-217997605 None] Lock "cinder-bffa85a2-c61a-44d1-b5b7-dc93fe1d1a06-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:44:13 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-58ddab32-a720-4aef-bbfe-6cc5ee37a571 tempest-CreateVolumesFromImageTest-217997605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:44:13 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-58ddab32-a720-4aef-bbfe-6cc5ee37a571 tempest-CreateVolumesFromImageTest-217997605 None] Acquiring lock "cinder-quobyte-bffa85a2-c61a-44d1-b5b7-dc93fe1d1a06" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:44:13 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-58ddab32-a720-4aef-bbfe-6cc5ee37a571 tempest-CreateVolumesFromImageTest-217997605 None] Lock "cinder-quobyte-bffa85a2-c61a-44d1-b5b7-dc93fe1d1a06" acquired by "delete_volume" :: waited 0.023s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:44:13 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6151ce-5033-4c79-9a27-54f2cbf40baa]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:44:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-58ddab32-a720-4aef-bbfe-6cc5ee37a571 tempest-CreateVolumesFromImageTest-217997605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-bffa85a2-c61a-44d1-b5b7-dc93fe1d1a06 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:44:13 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 11:44:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:44:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:44:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:44:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:44:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:44:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:44:13 devstack quobyte-client[83193]: System call of process 92265 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:44:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-58ddab32-a720-4aef-bbfe-6cc5ee37a571 tempest-CreateVolumesFromImageTest-217997605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-bffa85a2-c61a-44d1-b5b7-dc93fe1d1a06" returned: 0 in 0.735s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:44:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-58ddab32-a720-4aef-bbfe-6cc5ee37a571 tempest-CreateVolumesFromImageTest-217997605 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-bffa85a2-c61a-44d1-b5b7-dc93fe1d1a06 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:44:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.316s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:44:14 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:44:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-58ddab32-a720-4aef-bbfe-6cc5ee37a571 tempest-CreateVolumesFromImageTest-217997605 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-bffa85a2-c61a-44d1-b5b7-dc93fe1d1a06" returned: 0 in 0.271s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:44:14 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-58ddab32-a720-4aef-bbfe-6cc5ee37a571 tempest-CreateVolumesFromImageTest-217997605 None] Lock "cinder-quobyte-bffa85a2-c61a-44d1-b5b7-dc93fe1d1a06" released by "delete_volume" :: held 1.226s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:44:14 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-58ddab32-a720-4aef-bbfe-6cc5ee37a571 tempest-CreateVolumesFromImageTest-217997605 None] Created reservations ['63b2f21f-a266-4a66-9ca3-d382d834321a', '52fa92a9-9aa5-4d9b-aceb-8af53dd27450', '91b15864-4c30-4285-a22d-804f853315a3', 'c7de0160-a23d-43d5-8739-26da5e8f1f74'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:44:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-58ddab32-a720-4aef-bbfe-6cc5ee37a571 tempest-CreateVolumesFromImageTest-217997605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:44:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-58ddab32-a720-4aef-bbfe-6cc5ee37a571 tempest-CreateVolumesFromImageTest-217997605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:44:15 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-58ddab32-a720-4aef-bbfe-6cc5ee37a571 tempest-CreateVolumesFromImageTest-217997605 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:44:15 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-58ddab32-a720-4aef-bbfe-6cc5ee37a571 tempest-CreateVolumesFromImageTest-217997605 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:44:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-58ddab32-a720-4aef-bbfe-6cc5ee37a571 tempest-CreateVolumesFromImageTest-217997605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:44:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-58ddab32-a720-4aef-bbfe-6cc5ee37a571 tempest-CreateVolumesFromImageTest-217997605 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:44:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-58ddab32-a720-4aef-bbfe-6cc5ee37a571 tempest-CreateVolumesFromImageTest-217997605 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.108s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:44:15 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-58ddab32-a720-4aef-bbfe-6cc5ee37a571 tempest-CreateVolumesFromImageTest-217997605 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:44:15 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-58ddab32-a720-4aef-bbfe-6cc5ee37a571 tempest-CreateVolumesFromImageTest-217997605 None] Deleted volume successfully.
Sep 18 11:44:15 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-58ddab32-a720-4aef-bbfe-6cc5ee37a571 tempest-CreateVolumesFromImageTest-217997605 None] Lock "cinder-bffa85a2-c61a-44d1-b5b7-dc93fe1d1a06-delete_volume" released by "delete_volume" :: held 2.594s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:44:24 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:44:24 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:44:25 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Flow 'volume_create_manager' (151681f6-f03e-4302-bf11-69c8e61f999e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:44:25 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39d070e4-61cc-470e-8ddf-359754534252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:44:25 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39d070e4-61cc-470e-8ddf-359754534252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:44:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=039d8e79-b648-443a-a507-161b5020a327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42785447d1034585868b5c1258c3d031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:44:25Z,use_quota=True,user_id='c998860beebf4afeb1f29601a9aba914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:44:25 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aa33186-6c76-4229-b678-4782b8232e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:44:25 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aa33186-6c76-4229-b678-4782b8232e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:44:25 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f988be-7354-48b4-bacb-7afa883630a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:44:25 devstack cinder-volume[83176]: DEBUG cinder.image.glance [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Creating Keystone auth plugin from conf {{(pid=83176) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 18 11:44:25 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f988be-7354-48b4-bacb-7afa883630a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '039d8e79-b648-443a-a507-161b5020a327', 'volume_name': 'volume-039d8e79-b648-443a-a507-161b5020a327', 'volume_size': 1, 'image_id': '062e9a92-f312-4fd1-9bc4-a4cd73de34fe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/062e9a92-f312-4fd1-9bc4-a4cd73de34fe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b1c77d5649be90107bb9ea42f4f8c23a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '42785447d1034585868b5c1258c3d031', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd4a15134a4287fdff27afadcda2a7caf783e6ba25f7a858592acc8651c12ef834a19d3ca02bb654966af081d87bcc7b8d2307e91e4db10859c458f3994dd01b6', 'id': '062e9a92-f312-4fd1-9bc4-a4cd73de34fe', 'created_at': datetime.datetime(2025, 9, 18, 9, 44, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 9, 44, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/062e9a92-f312-4fd1-9bc4-a4cd73de34fe/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6ae44ca530>}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:44:25 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c81a6da6-1302-4b0f-9dfc-0396048d2ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:44:25 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c81a6da6-1302-4b0f-9dfc-0396048d2ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:44:25 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fec27a3e-f030-4480-b578-349c4a149a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:44:25 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Volume 039d8e79-b648-443a-a507-161b5020a327: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-039d8e79-b648-443a-a507-161b5020a327', 'volume_size': 1, 'image_id': '062e9a92-f312-4fd1-9bc4-a4cd73de34fe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/062e9a92-f312-4fd1-9bc4-a4cd73de34fe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b1c77d5649be90107bb9ea42f4f8c23a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '42785447d1034585868b5c1258c3d031', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd4a15134a4287fdff27afadcda2a7caf783e6ba25f7a858592acc8651c12ef834a19d3ca02bb654966af081d87bcc7b8d2307e91e4db10859c458f3994dd01b6', 'id': '062e9a92-f312-4fd1-9bc4-a4cd73de34fe', 'created_at': datetime.datetime(2025, 9, 18, 9, 44, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 9, 44, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/062e9a92-f312-4fd1-9bc4-a4cd73de34fe/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6ae44ca530>}
Sep 18 11:44:25 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Cloning 039d8e79-b648-443a-a507-161b5020a327 from image 062e9a92-f312-4fd1-9bc4-a4cd73de34fe  at location (None, [{'url': 'file:///opt/stack/data/glance/images/062e9a92-f312-4fd1-9bc4-a4cd73de34fe', 'metadata': {}}]). {{(pid=83176) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 18 11:44:25 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_062e9a92-f312-4fd1-9bc4-a4cd73de34fe_jtd1mv_ldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=83176) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 18 11:44:25 devstack cinder-volume[83176]: INFO cinder.image.image_utils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Image download 0.00 MB at 0.00 MB/s
Sep 18 11:44:25 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d286d5-e863-4d8b-ab9b-96ff446df630]: (4, 'raw') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:44:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_062e9a92-f312-4fd1-9bc4-a4cd73de34fe_jtd1mv_ldevstack@QuobyteHD {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:44:26 devstack sudo[92373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_062e9a92-f312-4fd1-9bc4-a4cd73de34fe_jtd1mv_ldevstack@QuobyteHD
Sep 18 11:44:26 devstack sudo[92373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:44:29 devstack sudo[92373]: pam_unix(sudo:session): session closed for user root
Sep 18 11:44:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_062e9a92-f312-4fd1-9bc4-a4cd73de34fe_jtd1mv_ldevstack@QuobyteHD" returned: 0 in 3.285s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:44:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_062e9a92-f312-4fd1-9bc4-a4cd73de34fe_jtd1mv_ldevstack@QuobyteHD {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:44:29 devstack sudo[92435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_062e9a92-f312-4fd1-9bc4-a4cd73de34fe_jtd1mv_ldevstack@QuobyteHD
Sep 18 11:44:29 devstack sudo[92435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:44:31 devstack sudo[92435]: pam_unix(sudo:session): session closed for user root
Sep 18 11:44:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_062e9a92-f312-4fd1-9bc4-a4cd73de34fe_jtd1mv_ldevstack@QuobyteHD" returned: 1 in 2.274s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:44:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_062e9a92-f312-4fd1-9bc4-a4cd73de34fe_jtd1mv_ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 11:44:31 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Temporary image 062e9a92-f312-4fd1-9bc4-a4cd73de34fe is fetched for user c998860beebf4afeb1f29601a9aba914. {{(pid=83176) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 18 11:44:31 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce130d1-8bd6-451b-9dcd-2a08071ce984]: (4, 'raw') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:44:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_062e9a92-f312-4fd1-9bc4-a4cd73de34fe_jtd1mv_ldevstack@QuobyteHD {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:44:32 devstack sudo[92440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_062e9a92-f312-4fd1-9bc4-a4cd73de34fe_jtd1mv_ldevstack@QuobyteHD
Sep 18 11:44:32 devstack sudo[92440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:44:34 devstack sudo[92440]: pam_unix(sudo:session): session closed for user root
Sep 18 11:44:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_062e9a92-f312-4fd1-9bc4-a4cd73de34fe_jtd1mv_ldevstack@QuobyteHD" returned: 0 in 2.305s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:44:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_062e9a92-f312-4fd1-9bc4-a4cd73de34fe_jtd1mv_ldevstack@QuobyteHD {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:44:34 devstack sudo[92447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_062e9a92-f312-4fd1-9bc4-a4cd73de34fe_jtd1mv_ldevstack@QuobyteHD
Sep 18 11:44:34 devstack sudo[92447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:44:37 devstack sudo[92447]: pam_unix(sudo:session): session closed for user root
Sep 18 11:44:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_062e9a92-f312-4fd1-9bc4-a4cd73de34fe_jtd1mv_ldevstack@QuobyteHD" returned: 1 in 3.570s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:44:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_062e9a92-f312-4fd1-9bc4-a4cd73de34fe_jtd1mv_ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 11:44:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:44:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.011s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:44:37 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:44:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=039d8e79-b648-443a-a507-161b5020a327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42785447d1034585868b5c1258c3d031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:44:25Z,use_quota=True,user_id='c998860beebf4afeb1f29601a9aba914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:44:37 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Creating volume 039d8e79-b648-443a-a507-161b5020a327 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:44:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:44:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:44:37 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:44:38 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:44:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:44:38 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:44:38 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:44:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-039d8e79-b648-443a-a507-161b5020a327 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:44:38 devstack quobyte-client[83193]: System call of process 92462 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:44:38 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=50, name=volume-039d8e79-b648-443a-a507-161b5020a327, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:44:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-039d8e79-b648-443a-a507-161b5020a327 1073741824" returned: 0 in 0.660s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:44:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-039d8e79-b648-443a-a507-161b5020a327 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:44:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-039d8e79-b648-443a-a507-161b5020a327" returned: 0 in 0.187s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:44:39 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] <== create_volume: return (1026ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:44:39 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:44:39 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-a1a11d22-8e3c-4cc5-901a-2c8e731c39bb req-355c88a5-1e7f-4710-a725-3cccc72fe448 tempest-AttachVolumeNegativeTest-652039892 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:44:39 devstack cinder-volume[83176]: DEBUG cinder.volume.volume_utils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Attempting download of 062e9a92-f312-4fd1-9bc4-a4cd73de34fe ((None, [{'url': 'file:///opt/stack/data/glance/images/062e9a92-f312-4fd1-9bc4-a4cd73de34fe', 'metadata': {}}])) to volume 039d8e79-b648-443a-a507-161b5020a327. {{(pid=83176) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 18 11:44:39 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-a1a11d22-8e3c-4cc5-901a-2c8e731c39bb req-355c88a5-1e7f-4710-a725-3cccc72fe448 tempest-AttachVolumeNegativeTest-652039892 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:44:39 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-a1a11d22-8e3c-4cc5-901a-2c8e731c39bb req-355c88a5-1e7f-4710-a725-3cccc72fe448 tempest-AttachVolumeNegativeTest-652039892 None] Terminate volume connection completed successfully.
Sep 18 11:44:39 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-a1a11d22-8e3c-4cc5-901a-2c8e731c39bb req-355c88a5-1e7f-4710-a725-3cccc72fe448 tempest-AttachVolumeNegativeTest-652039892 None] Deleting attachment 03d43142-6233-4bec-b1a4-c5615bfc7580. {{(pid=83176) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 11:44:40 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d8eb6d-6d16-4b43-9a0f-5c7542fa3460]: (4, 'raw') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:44:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_062e9a92-f312-4fd1-9bc4-a4cd73de34fe_v5qj3eiw {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:44:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_062e9a92-f312-4fd1-9bc4-a4cd73de34fe_v5qj3eiw" returned: 0 in 0.645s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:44:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_062e9a92-f312-4fd1-9bc4-a4cd73de34fe_v5qj3eiw {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:44:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_062e9a92-f312-4fd1-9bc4-a4cd73de34fe_v5qj3eiw" returned: 1 in 0.468s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:44:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_062e9a92-f312-4fd1-9bc4-a4cd73de34fe_v5qj3eiw' failed. Not Retrying. {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 11:44:41 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9128a49c-0477-4dd1-b0bf-b4050dee1287]: (4, 'raw') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:44:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_062e9a92-f312-4fd1-9bc4-a4cd73de34fe_jtd1mv_ldevstack@QuobyteHD {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:44:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_062e9a92-f312-4fd1-9bc4-a4cd73de34fe_jtd1mv_ldevstack@QuobyteHD" returned: 0 in 0.443s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:44:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_062e9a92-f312-4fd1-9bc4-a4cd73de34fe_jtd1mv_ldevstack@QuobyteHD {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:44:42 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_062e9a92-f312-4fd1-9bc4-a4cd73de34fe_jtd1mv_ldevstack@QuobyteHD" returned: 1 in 0.920s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:44:42 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_062e9a92-f312-4fd1-9bc4-a4cd73de34fe_jtd1mv_ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 11:44:42 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] 062e9a92-f312-4fd1-9bc4-a4cd73de34fe was raw, converting to raw {{(pid=83176) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 18 11:44:42 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_062e9a92-f312-4fd1-9bc4-a4cd73de34fe_jtd1mv_ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-039d8e79-b648-443a-a507-161b5020a327 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:44:43 devstack quobyte-client[83193]: System call of process 92481 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:44:43 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=50, name=volume-039d8e79-b648-443a-a507-161b5020a327, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:44:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_062e9a92-f312-4fd1-9bc4-a4cd73de34fe_jtd1mv_ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-039d8e79-b648-443a-a507-161b5020a327" returned: 0 in 0.431s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:44:43 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_062e9a92-f312-4fd1-9bc4-a4cd73de34fe_jtd1mv_ldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-039d8e79-b648-443a-a507-161b5020a327 {{(pid=83176) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 11:44:43 devstack cinder-volume[83176]: INFO cinder.image.image_utils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Converted 0.00 MB image at 0.00 MB/s
Sep 18 11:44:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-039d8e79-b648-443a-a507-161b5020a327 1G {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:44:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-039d8e79-b648-443a-a507-161b5020a327 1G" returned: 0 in 0.264s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:44:43 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37470e0-3eb4-4af3-b98e-0025594cbab5]: (4, 'raw') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:44:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-039d8e79-b648-443a-a507-161b5020a327 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:44:44 devstack quobyte-client[83193]: System call of process 92487 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:44:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-039d8e79-b648-443a-a507-161b5020a327" returned: 0 in 0.968s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:44:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-039d8e79-b648-443a-a507-161b5020a327 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:44:46 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-039d8e79-b648-443a-a507-161b5020a327" returned: 1 in 1.883s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:44:46 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-039d8e79-b648-443a-a507-161b5020a327' failed. Not Retrying. {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 11:44:46 devstack cinder-volume[83176]: DEBUG cinder.volume.volume_utils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Downloaded image 062e9a92-f312-4fd1-9bc4-a4cd73de34fe ((None, [{'url': 'file:///opt/stack/data/glance/images/062e9a92-f312-4fd1-9bc4-a4cd73de34fe', 'metadata': {}}])) to volume 039d8e79-b648-443a-a507-161b5020a327 successfully. {{(pid=83176) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 18 11:44:46 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Temporary image 062e9a92-f312-4fd1-9bc4-a4cd73de34fe for user c998860beebf4afeb1f29601a9aba914 is deleted. {{(pid=83176) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 18 11:44:46 devstack cinder-volume[83176]: DEBUG cinder.volume.volume_utils [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Marking volume 039d8e79-b648-443a-a507-161b5020a327 as bootable. {{(pid=83176) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 18 11:44:47 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Copying metadata from image 062e9a92-f312-4fd1-9bc4-a4cd73de34fe to 039d8e79-b648-443a-a507-161b5020a327. {{(pid=83176) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 18 11:44:47 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Creating volume glance metadata for volume 039d8e79-b648-443a-a507-161b5020a327 backed by image 062e9a92-f312-4fd1-9bc4-a4cd73de34fe with: {'image_id': '062e9a92-f312-4fd1-9bc4-a4cd73de34fe', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'b1c77d5649be90107bb9ea42f4f8c23a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=83176) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 18 11:44:48 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fec27a3e-f030-4480-b578-349c4a149a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-039d8e79-b648-443a-a507-161b5020a327', 'volume_size': 1, 'image_id': '062e9a92-f312-4fd1-9bc4-a4cd73de34fe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/062e9a92-f312-4fd1-9bc4-a4cd73de34fe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b1c77d5649be90107bb9ea42f4f8c23a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '42785447d1034585868b5c1258c3d031', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd4a15134a4287fdff27afadcda2a7caf783e6ba25f7a858592acc8651c12ef834a19d3ca02bb654966af081d87bcc7b8d2307e91e4db10859c458f3994dd01b6', 'id': '062e9a92-f312-4fd1-9bc4-a4cd73de34fe', 'created_at': datetime.datetime(2025, 9, 18, 9, 44, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 9, 44, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/062e9a92-f312-4fd1-9bc4-a4cd73de34fe/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6ae44ca530>}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:44:48 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40232e18-2c95-4fee-bb14-befb7f2a7df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:44:48 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Volume volume-039d8e79-b648-443a-a507-161b5020a327 (039d8e79-b648-443a-a507-161b5020a327): created successfully
Sep 18 11:44:48 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40232e18-2c95-4fee-bb14-befb7f2a7df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:44:48 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Flow 'volume_create_manager' (151681f6-f03e-4302-bf11-69c8e61f999e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:44:48 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-489e0806-c9b3-4b07-88f2-57e151c5835f tempest-VolumeImageDependencyTests-1609439803 None] Created volume successfully.
Sep 18 11:44:49 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-efcab082-5266-4bc0-bad6-070729b70a4c tempest-VolumeImageDependencyTests-1609439803 None] Acquiring lock "cinder-039d8e79-b648-443a-a507-161b5020a327-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:44:49 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-efcab082-5266-4bc0-bad6-070729b70a4c tempest-VolumeImageDependencyTests-1609439803 None] Lock "cinder-039d8e79-b648-443a-a507-161b5020a327-delete_volume" acquired by "delete_volume" :: waited 0.160s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:44:49 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-efcab082-5266-4bc0-bad6-070729b70a4c tempest-VolumeImageDependencyTests-1609439803 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:44:49 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-efcab082-5266-4bc0-bad6-070729b70a4c tempest-VolumeImageDependencyTests-1609439803 None] Acquiring lock "cinder-quobyte-039d8e79-b648-443a-a507-161b5020a327" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:44:49 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-efcab082-5266-4bc0-bad6-070729b70a4c tempest-VolumeImageDependencyTests-1609439803 None] Lock "cinder-quobyte-039d8e79-b648-443a-a507-161b5020a327" acquired by "delete_volume" :: waited 0.033s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:44:49 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fa0c07-c870-4609-accc-dd56fef1627b]: (4, 'raw') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:44:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-efcab082-5266-4bc0-bad6-070729b70a4c tempest-VolumeImageDependencyTests-1609439803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-039d8e79-b648-443a-a507-161b5020a327 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:44:51 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-efcab082-5266-4bc0-bad6-070729b70a4c tempest-VolumeImageDependencyTests-1609439803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-039d8e79-b648-443a-a507-161b5020a327" returned: 0 in 1.357s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:44:51 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-efcab082-5266-4bc0-bad6-070729b70a4c tempest-VolumeImageDependencyTests-1609439803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-039d8e79-b648-443a-a507-161b5020a327 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:44:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-efcab082-5266-4bc0-bad6-070729b70a4c tempest-VolumeImageDependencyTests-1609439803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-039d8e79-b648-443a-a507-161b5020a327" returned: 1 in 1.212s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:44:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-efcab082-5266-4bc0-bad6-070729b70a4c tempest-VolumeImageDependencyTests-1609439803 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-039d8e79-b648-443a-a507-161b5020a327' failed. Not Retrying. {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 11:44:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-efcab082-5266-4bc0-bad6-070729b70a4c tempest-VolumeImageDependencyTests-1609439803 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-039d8e79-b648-443a-a507-161b5020a327 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:44:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-efcab082-5266-4bc0-bad6-070729b70a4c tempest-VolumeImageDependencyTests-1609439803 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-039d8e79-b648-443a-a507-161b5020a327" returned: 0 in 0.195s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:44:52 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-efcab082-5266-4bc0-bad6-070729b70a4c tempest-VolumeImageDependencyTests-1609439803 None] Lock "cinder-quobyte-039d8e79-b648-443a-a507-161b5020a327" released by "delete_volume" :: held 3.110s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:44:53 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-efcab082-5266-4bc0-bad6-070729b70a4c tempest-VolumeImageDependencyTests-1609439803 None] Created reservations ['aac1d64a-bc78-43f6-850c-b8e44d489025', 'dc0aa816-d79d-44e7-800a-948c0fad1250', '89d68c1d-791f-4e8d-b9f5-e8b522104cb6', '34e04a60-f804-4867-9183-0e7b00604079'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:44:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-efcab082-5266-4bc0-bad6-070729b70a4c tempest-VolumeImageDependencyTests-1609439803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:44:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-efcab082-5266-4bc0-bad6-070729b70a4c tempest-VolumeImageDependencyTests-1609439803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:44:53 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-efcab082-5266-4bc0-bad6-070729b70a4c tempest-VolumeImageDependencyTests-1609439803 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:44:53 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-efcab082-5266-4bc0-bad6-070729b70a4c tempest-VolumeImageDependencyTests-1609439803 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:44:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-efcab082-5266-4bc0-bad6-070729b70a4c tempest-VolumeImageDependencyTests-1609439803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:44:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-efcab082-5266-4bc0-bad6-070729b70a4c tempest-VolumeImageDependencyTests-1609439803 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:44:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-efcab082-5266-4bc0-bad6-070729b70a4c tempest-VolumeImageDependencyTests-1609439803 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.112s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:44:53 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-efcab082-5266-4bc0-bad6-070729b70a4c tempest-VolumeImageDependencyTests-1609439803 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:44:54 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-efcab082-5266-4bc0-bad6-070729b70a4c tempest-VolumeImageDependencyTests-1609439803 None] Deleted volume successfully.
Sep 18 11:44:54 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-efcab082-5266-4bc0-bad6-070729b70a4c tempest-VolumeImageDependencyTests-1609439803 None] Lock "cinder-039d8e79-b648-443a-a507-161b5020a327-delete_volume" released by "delete_volume" :: held 4.626s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:45:01 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:UPDATE=56,cinder:DELETE=5,cinder:SELECT=44,cinder:INSERT=18 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:45:01 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:DELETE=8,cinder:UPDATE=70,cinder:SELECT=44,cinder:INSERT=15 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:45:01 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-55c227ab-c2d1-44a7-933c-221959366dca tempest-CinderUnicodeTest-254508286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:45:01 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-55c227ab-c2d1-44a7-933c-221959366dca tempest-CinderUnicodeTest-254508286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:45:01 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-55c227ab-c2d1-44a7-933c-221959366dca tempest-CinderUnicodeTest-254508286 None] Flow 'volume_create_manager' (4aae501b-ba0b-4ada-b98f-bd6b9c8f3865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:45:01 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-55c227ab-c2d1-44a7-933c-221959366dca tempest-CinderUnicodeTest-254508286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78387b54-d981-4dfd-8674-9791c202af37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:45:01 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-55c227ab-c2d1-44a7-933c-221959366dca tempest-CinderUnicodeTest-254508286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78387b54-d981-4dfd-8674-9791c202af37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ae357fc-d53e-483d-9bdf-04cdfea58642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84421aa73f7c4b5eab11a3ded73d5603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:45:01Z,use_quota=True,user_id='bd9900bbb9bb4dabadd971ab6ca1cb41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:45:01 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-55c227ab-c2d1-44a7-933c-221959366dca tempest-CinderUnicodeTest-254508286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12a8a9d3-45c7-4857-bdde-1aff767a7c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:45:01 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-55c227ab-c2d1-44a7-933c-221959366dca tempest-CinderUnicodeTest-254508286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12a8a9d3-45c7-4857-bdde-1aff767a7c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:45:01 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-55c227ab-c2d1-44a7-933c-221959366dca tempest-CinderUnicodeTest-254508286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b834e351-dd50-4333-8b6e-8daa3b96c7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:45:01 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-55c227ab-c2d1-44a7-933c-221959366dca tempest-CinderUnicodeTest-254508286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b834e351-dd50-4333-8b6e-8daa3b96c7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ae357fc-d53e-483d-9bdf-04cdfea58642', 'volume_name': 'volume-4ae357fc-d53e-483d-9bdf-04cdfea58642', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:45:01 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-55c227ab-c2d1-44a7-933c-221959366dca tempest-CinderUnicodeTest-254508286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3b12fe6-0368-49d8-bc7b-e643a8d19c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:45:01 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-55c227ab-c2d1-44a7-933c-221959366dca tempest-CinderUnicodeTest-254508286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3b12fe6-0368-49d8-bc7b-e643a8d19c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:45:01 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-55c227ab-c2d1-44a7-933c-221959366dca tempest-CinderUnicodeTest-254508286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f06e0bf4-dafb-4c45-9c24-e2b39ac1500e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:45:01 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-55c227ab-c2d1-44a7-933c-221959366dca tempest-CinderUnicodeTest-254508286 None] Volume 4ae357fc-d53e-483d-9bdf-04cdfea58642: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ae357fc-d53e-483d-9bdf-04cdfea58642', 'volume_size': 1}
Sep 18 11:45:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-55c227ab-c2d1-44a7-933c-221959366dca tempest-CinderUnicodeTest-254508286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:45:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-55c227ab-c2d1-44a7-933c-221959366dca tempest-CinderUnicodeTest-254508286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:45:01 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-55c227ab-c2d1-44a7-933c-221959366dca tempest-CinderUnicodeTest-254508286 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ae357fc-d53e-483d-9bdf-04cdfea58642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84421aa73f7c4b5eab11a3ded73d5603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:45:01Z,use_quota=True,user_id='bd9900bbb9bb4dabadd971ab6ca1cb41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:45:01 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-55c227ab-c2d1-44a7-933c-221959366dca tempest-CinderUnicodeTest-254508286 None] Creating volume 4ae357fc-d53e-483d-9bdf-04cdfea58642 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:45:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-55c227ab-c2d1-44a7-933c-221959366dca tempest-CinderUnicodeTest-254508286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:45:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-55c227ab-c2d1-44a7-933c-221959366dca tempest-CinderUnicodeTest-254508286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:45:01 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-55c227ab-c2d1-44a7-933c-221959366dca tempest-CinderUnicodeTest-254508286 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:45:01 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-55c227ab-c2d1-44a7-933c-221959366dca tempest-CinderUnicodeTest-254508286 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:45:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-55c227ab-c2d1-44a7-933c-221959366dca tempest-CinderUnicodeTest-254508286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:45:01 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-55c227ab-c2d1-44a7-933c-221959366dca tempest-CinderUnicodeTest-254508286 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:45:01 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-55c227ab-c2d1-44a7-933c-221959366dca tempest-CinderUnicodeTest-254508286 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:45:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-55c227ab-c2d1-44a7-933c-221959366dca tempest-CinderUnicodeTest-254508286 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ae357fc-d53e-483d-9bdf-04cdfea58642 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:45:02 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=51, name=volume-4ae357fc-d53e-483d-9bdf-04cdfea58642, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:45:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-55c227ab-c2d1-44a7-933c-221959366dca tempest-CinderUnicodeTest-254508286 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ae357fc-d53e-483d-9bdf-04cdfea58642 1073741824" returned: 0 in 0.480s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:45:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-55c227ab-c2d1-44a7-933c-221959366dca tempest-CinderUnicodeTest-254508286 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ae357fc-d53e-483d-9bdf-04cdfea58642 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:45:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-55c227ab-c2d1-44a7-933c-221959366dca tempest-CinderUnicodeTest-254508286 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ae357fc-d53e-483d-9bdf-04cdfea58642" returned: 0 in 0.190s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:45:02 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-55c227ab-c2d1-44a7-933c-221959366dca tempest-CinderUnicodeTest-254508286 None] <== create_volume: return (747ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:45:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-55c227ab-c2d1-44a7-933c-221959366dca tempest-CinderUnicodeTest-254508286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:45:02 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-55c227ab-c2d1-44a7-933c-221959366dca tempest-CinderUnicodeTest-254508286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f06e0bf4-dafb-4c45-9c24-e2b39ac1500e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ae357fc-d53e-483d-9bdf-04cdfea58642', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:45:02 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-55c227ab-c2d1-44a7-933c-221959366dca tempest-CinderUnicodeTest-254508286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09e17173-761f-4e29-85fa-9097cd0c2417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:45:02 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-55c227ab-c2d1-44a7-933c-221959366dca tempest-CinderUnicodeTest-254508286 None] Volume volume-4ae357fc-d53e-483d-9bdf-04cdfea58642 (4ae357fc-d53e-483d-9bdf-04cdfea58642): created successfully
Sep 18 11:45:02 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-55c227ab-c2d1-44a7-933c-221959366dca tempest-CinderUnicodeTest-254508286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09e17173-761f-4e29-85fa-9097cd0c2417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:45:02 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-55c227ab-c2d1-44a7-933c-221959366dca tempest-CinderUnicodeTest-254508286 None] Flow 'volume_create_manager' (4aae501b-ba0b-4ada-b98f-bd6b9c8f3865) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:45:02 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-55c227ab-c2d1-44a7-933c-221959366dca tempest-CinderUnicodeTest-254508286 None] Created volume successfully.
Sep 18 11:45:05 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-3b811f7b-7af6-4a60-8b3e-65301999a179 tempest-CinderUnicodeTest-254508286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:45:05 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b811f7b-7af6-4a60-8b3e-65301999a179 tempest-CinderUnicodeTest-254508286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:45:05 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3b811f7b-7af6-4a60-8b3e-65301999a179 tempest-CinderUnicodeTest-254508286 None] Flow 'volume_create_manager' (e352e2d3-5646-479d-b71c-6636cadd05c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:45:05 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3b811f7b-7af6-4a60-8b3e-65301999a179 tempest-CinderUnicodeTest-254508286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bc225e2-31c5-42e6-808a-8acafb04b095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:45:05 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3b811f7b-7af6-4a60-8b3e-65301999a179 tempest-CinderUnicodeTest-254508286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bc225e2-31c5-42e6-808a-8acafb04b095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:45:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-41264300',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3431c96-5dfb-4434-8dfc-6bfdc3e647b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84421aa73f7c4b5eab11a3ded73d5603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:45:05Z,use_quota=True,user_id='bd9900bbb9bb4dabadd971ab6ca1cb41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:45:05 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3b811f7b-7af6-4a60-8b3e-65301999a179 tempest-CinderUnicodeTest-254508286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64eb13c0-2122-4bee-9543-d9b40d194a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:45:05 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3b811f7b-7af6-4a60-8b3e-65301999a179 tempest-CinderUnicodeTest-254508286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64eb13c0-2122-4bee-9543-d9b40d194a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:45:05 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3b811f7b-7af6-4a60-8b3e-65301999a179 tempest-CinderUnicodeTest-254508286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d6f3b4-daeb-4533-a1e0-6c9fc0e5f90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:45:05 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3b811f7b-7af6-4a60-8b3e-65301999a179 tempest-CinderUnicodeTest-254508286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d6f3b4-daeb-4533-a1e0-6c9fc0e5f90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3431c96-5dfb-4434-8dfc-6bfdc3e647b0', 'volume_name': 'volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:45:05 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3b811f7b-7af6-4a60-8b3e-65301999a179 tempest-CinderUnicodeTest-254508286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0e5f8b2-7fbb-4ace-946f-32618ff98979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:45:05 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3b811f7b-7af6-4a60-8b3e-65301999a179 tempest-CinderUnicodeTest-254508286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0e5f8b2-7fbb-4ace-946f-32618ff98979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:45:05 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3b811f7b-7af6-4a60-8b3e-65301999a179 tempest-CinderUnicodeTest-254508286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fa43a0a-2da1-4ed8-814d-fd935cc7b2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:45:05 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-3b811f7b-7af6-4a60-8b3e-65301999a179 tempest-CinderUnicodeTest-254508286 None] Volume d3431c96-5dfb-4434-8dfc-6bfdc3e647b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0', 'volume_size': 1}
Sep 18 11:45:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-3b811f7b-7af6-4a60-8b3e-65301999a179 tempest-CinderUnicodeTest-254508286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:45:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-3b811f7b-7af6-4a60-8b3e-65301999a179 tempest-CinderUnicodeTest-254508286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:45:05 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-3b811f7b-7af6-4a60-8b3e-65301999a179 tempest-CinderUnicodeTest-254508286 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:45:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-41264300',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3431c96-5dfb-4434-8dfc-6bfdc3e647b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84421aa73f7c4b5eab11a3ded73d5603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:45:05Z,use_quota=True,user_id='bd9900bbb9bb4dabadd971ab6ca1cb41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:45:05 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-3b811f7b-7af6-4a60-8b3e-65301999a179 tempest-CinderUnicodeTest-254508286 None] Creating volume d3431c96-5dfb-4434-8dfc-6bfdc3e647b0 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:45:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-3b811f7b-7af6-4a60-8b3e-65301999a179 tempest-CinderUnicodeTest-254508286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:45:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-3b811f7b-7af6-4a60-8b3e-65301999a179 tempest-CinderUnicodeTest-254508286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:45:05 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-3b811f7b-7af6-4a60-8b3e-65301999a179 tempest-CinderUnicodeTest-254508286 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:45:05 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-3b811f7b-7af6-4a60-8b3e-65301999a179 tempest-CinderUnicodeTest-254508286 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:45:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-3b811f7b-7af6-4a60-8b3e-65301999a179 tempest-CinderUnicodeTest-254508286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:45:05 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-3b811f7b-7af6-4a60-8b3e-65301999a179 tempest-CinderUnicodeTest-254508286 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:45:05 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-3b811f7b-7af6-4a60-8b3e-65301999a179 tempest-CinderUnicodeTest-254508286 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:45:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-3b811f7b-7af6-4a60-8b3e-65301999a179 tempest-CinderUnicodeTest-254508286 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:45:05 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=52, name=volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:45:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-3b811f7b-7af6-4a60-8b3e-65301999a179 tempest-CinderUnicodeTest-254508286 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0 1073741824" returned: 0 in 0.457s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:45:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-3b811f7b-7af6-4a60-8b3e-65301999a179 tempest-CinderUnicodeTest-254508286 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:45:06 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-3b811f7b-7af6-4a60-8b3e-65301999a179 tempest-CinderUnicodeTest-254508286 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0" returned: 0 in 0.179s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:45:06 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-3b811f7b-7af6-4a60-8b3e-65301999a179 tempest-CinderUnicodeTest-254508286 None] <== create_volume: return (733ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:45:06 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-3b811f7b-7af6-4a60-8b3e-65301999a179 tempest-CinderUnicodeTest-254508286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:45:06 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3b811f7b-7af6-4a60-8b3e-65301999a179 tempest-CinderUnicodeTest-254508286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fa43a0a-2da1-4ed8-814d-fd935cc7b2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:45:06 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3b811f7b-7af6-4a60-8b3e-65301999a179 tempest-CinderUnicodeTest-254508286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (362797db-9f0a-429b-9c40-111bc56c3af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:45:06 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-3b811f7b-7af6-4a60-8b3e-65301999a179 tempest-CinderUnicodeTest-254508286 None] Volume volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0 (d3431c96-5dfb-4434-8dfc-6bfdc3e647b0): created successfully
Sep 18 11:45:06 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3b811f7b-7af6-4a60-8b3e-65301999a179 tempest-CinderUnicodeTest-254508286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (362797db-9f0a-429b-9c40-111bc56c3af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:45:06 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3b811f7b-7af6-4a60-8b3e-65301999a179 tempest-CinderUnicodeTest-254508286 None] Flow 'volume_create_manager' (e352e2d3-5646-479d-b71c-6636cadd05c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:45:06 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-3b811f7b-7af6-4a60-8b3e-65301999a179 tempest-CinderUnicodeTest-254508286 None] Created volume successfully.
Sep 18 11:45:08 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-61f3f4f1-ad89-4f28-82d8-6018eda1a6c5 tempest-CinderUnicodeTest-254508286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:45:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-61f3f4f1-ad89-4f28-82d8-6018eda1a6c5 tempest-CinderUnicodeTest-254508286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:45:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-61f3f4f1-ad89-4f28-82d8-6018eda1a6c5 tempest-CinderUnicodeTest-254508286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:45:08 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-61f3f4f1-ad89-4f28-82d8-6018eda1a6c5 tempest-CinderUnicodeTest-254508286 None] Creating offline snapshot afe0c065-28e4-40f1-b9c4-fb593161033a of volume d3431c96-5dfb-4434-8dfc-6bfdc3e647b0 {{(pid=83176) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 11:45:08 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[605ba552-a233-429f-bb7e-a38a64f423e6]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:45:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-61f3f4f1-ad89-4f28-82d8-6018eda1a6c5 tempest-CinderUnicodeTest-254508286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:45:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-61f3f4f1-ad89-4f28-82d8-6018eda1a6c5 tempest-CinderUnicodeTest-254508286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0" returned: 0 in 0.832s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:45:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-61f3f4f1-ad89-4f28-82d8-6018eda1a6c5 tempest-CinderUnicodeTest-254508286 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0.afe0c065-28e4-40f1-b9c4-fb593161033a 1G {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:45:09 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=53, name=volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0.afe0c065-28e4-40f1-b9c4-fb593161033a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:45:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-61f3f4f1-ad89-4f28-82d8-6018eda1a6c5 tempest-CinderUnicodeTest-254508286 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0.afe0c065-28e4-40f1-b9c4-fb593161033a 1G" returned: 0 in 0.307s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:45:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-61f3f4f1-ad89-4f28-82d8-6018eda1a6c5 tempest-CinderUnicodeTest-254508286 None] Running cmd (subprocess): qemu-img rebase -u -b volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0 -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0.afe0c065-28e4-40f1-b9c4-fb593161033a {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:45:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-61f3f4f1-ad89-4f28-82d8-6018eda1a6c5 tempest-CinderUnicodeTest-254508286 None] CMD "qemu-img rebase -u -b volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0 -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0.afe0c065-28e4-40f1-b9c4-fb593161033a" returned: 0 in 0.147s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:45:09 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-61f3f4f1-ad89-4f28-82d8-6018eda1a6c5 tempest-CinderUnicodeTest-254508286 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0.afe0c065-28e4-40f1-b9c4-fb593161033a is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 11:45:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-61f3f4f1-ad89-4f28-82d8-6018eda1a6c5 tempest-CinderUnicodeTest-254508286 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0.afe0c065-28e4-40f1-b9c4-fb593161033a {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:45:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-61f3f4f1-ad89-4f28-82d8-6018eda1a6c5 tempest-CinderUnicodeTest-254508286 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0.afe0c065-28e4-40f1-b9c4-fb593161033a" returned: 0 in 0.109s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:45:09 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-61f3f4f1-ad89-4f28-82d8-6018eda1a6c5 tempest-CinderUnicodeTest-254508286 None] Setting permissions: /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0 -> 1000:1000 {{(pid=83176) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 11:45:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-61f3f4f1-ad89-4f28-82d8-6018eda1a6c5 tempest-CinderUnicodeTest-254508286 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0.afe0c065-28e4-40f1-b9c4-fb593161033a {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:45:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-61f3f4f1-ad89-4f28-82d8-6018eda1a6c5 tempest-CinderUnicodeTest-254508286 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0.afe0c065-28e4-40f1-b9c4-fb593161033a" returned: 0 in 0.179s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:45:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-61f3f4f1-ad89-4f28-82d8-6018eda1a6c5 tempest-CinderUnicodeTest-254508286 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0.info {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:45:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-61f3f4f1-ad89-4f28-82d8-6018eda1a6c5 tempest-CinderUnicodeTest-254508286 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0.info" returned: 0 in 0.184s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:45:10 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-61f3f4f1-ad89-4f28-82d8-6018eda1a6c5 tempest-CinderUnicodeTest-254508286 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0.info is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 11:45:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-61f3f4f1-ad89-4f28-82d8-6018eda1a6c5 tempest-CinderUnicodeTest-254508286 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0.info {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:45:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-61f3f4f1-ad89-4f28-82d8-6018eda1a6c5 tempest-CinderUnicodeTest-254508286 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0.info" returned: 0 in 0.195s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:45:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-61f3f4f1-ad89-4f28-82d8-6018eda1a6c5 tempest-CinderUnicodeTest-254508286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.401s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:45:10 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-61f3f4f1-ad89-4f28-82d8-6018eda1a6c5 tempest-CinderUnicodeTest-254508286 None] Create snapshot completed successfully
Sep 18 11:45:11 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-af26334c-780d-494f-a86d-e6b7f39f3257 tempest-CinderUnicodeTest-254508286 None] Acquiring lock "cinder-afe0c065-28e4-40f1-b9c4-fb593161033a-delete_snapshot" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:45:11 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-af26334c-780d-494f-a86d-e6b7f39f3257 tempest-CinderUnicodeTest-254508286 None] Lock "cinder-afe0c065-28e4-40f1-b9c4-fb593161033a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:45:11 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-af26334c-780d-494f-a86d-e6b7f39f3257 tempest-CinderUnicodeTest-254508286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:45:11 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-af26334c-780d-494f-a86d-e6b7f39f3257 tempest-CinderUnicodeTest-254508286 None] Acquiring lock "cinder-quobyte-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:45:11 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-af26334c-780d-494f-a86d-e6b7f39f3257 tempest-CinderUnicodeTest-254508286 None] Lock "cinder-quobyte-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:45:11 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-af26334c-780d-494f-a86d-e6b7f39f3257 tempest-CinderUnicodeTest-254508286 None] Acquiring lock "cinder-quobyte-afe0c065-28e4-40f1-b9c4-fb593161033a" by "_delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:45:11 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-af26334c-780d-494f-a86d-e6b7f39f3257 tempest-CinderUnicodeTest-254508286 None] Lock "cinder-quobyte-afe0c065-28e4-40f1-b9c4-fb593161033a" acquired by "_delete_snapshot" :: waited 0.057s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:45:11 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-af26334c-780d-494f-a86d-e6b7f39f3257 tempest-CinderUnicodeTest-254508286 None] Deleting offline snapshot afe0c065-28e4-40f1-b9c4-fb593161033a of volume d3431c96-5dfb-4434-8dfc-6bfdc3e647b0 {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 11:45:11 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-af26334c-780d-494f-a86d-e6b7f39f3257 tempest-CinderUnicodeTest-254508286 None] snapshot_file for this snap is: volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0.afe0c065-28e4-40f1-b9c4-fb593161033a {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 11:45:11 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5173c07-bd5e-459a-a745-d1a3e67173ba]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:45:11 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-af26334c-780d-494f-a86d-e6b7f39f3257 tempest-CinderUnicodeTest-254508286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0.afe0c065-28e4-40f1-b9c4-fb593161033a {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:45:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-af26334c-780d-494f-a86d-e6b7f39f3257 tempest-CinderUnicodeTest-254508286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0.afe0c065-28e4-40f1-b9c4-fb593161033a" returned: 0 in 0.477s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:45:12 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-af26334c-780d-494f-a86d-e6b7f39f3257 tempest-CinderUnicodeTest-254508286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 11:45:12 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3d00f8-bf26-415c-bc7a-be814d474e54]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:45:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-af26334c-780d-494f-a86d-e6b7f39f3257 tempest-CinderUnicodeTest-254508286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:45:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-af26334c-780d-494f-a86d-e6b7f39f3257 tempest-CinderUnicodeTest-254508286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0" returned: 0 in 0.442s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:45:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-af26334c-780d-494f-a86d-e6b7f39f3257 tempest-CinderUnicodeTest-254508286 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0.afe0c065-28e4-40f1-b9c4-fb593161033a {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:45:12 devstack quobyte-client[83193]: System call of process 92595 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:45:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-af26334c-780d-494f-a86d-e6b7f39f3257 tempest-CinderUnicodeTest-254508286 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0.afe0c065-28e4-40f1-b9c4-fb593161033a" returned: 0 in 0.238s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:45:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-af26334c-780d-494f-a86d-e6b7f39f3257 tempest-CinderUnicodeTest-254508286 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0.afe0c065-28e4-40f1-b9c4-fb593161033a {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:45:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-af26334c-780d-494f-a86d-e6b7f39f3257 tempest-CinderUnicodeTest-254508286 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0.afe0c065-28e4-40f1-b9c4-fb593161033a" returned: 0 in 0.099s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:45:13 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-af26334c-780d-494f-a86d-e6b7f39f3257 tempest-CinderUnicodeTest-254508286 None] Lock "cinder-quobyte-afe0c065-28e4-40f1-b9c4-fb593161033a" released by "_delete_snapshot" :: held 1.548s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:45:13 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-af26334c-780d-494f-a86d-e6b7f39f3257 tempest-CinderUnicodeTest-254508286 None] Lock "cinder-quobyte-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0" released by "delete_snapshot" :: held 1.618s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:45:13 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-af26334c-780d-494f-a86d-e6b7f39f3257 tempest-CinderUnicodeTest-254508286 None] Created reservations ['102a9892-88c0-4b14-9b60-8f87fb8a712a', 'f9b167b4-9a20-4375-935c-2f920468a52c', 'a1ad3d21-4856-49f5-98ec-5ebff6a35bfa', '865bfdab-1a34-421e-974c-03d01d916777'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:45:13 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-af26334c-780d-494f-a86d-e6b7f39f3257 tempest-CinderUnicodeTest-254508286 None] Delete snapshot completed successfully.
Sep 18 11:45:13 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-af26334c-780d-494f-a86d-e6b7f39f3257 tempest-CinderUnicodeTest-254508286 None] Lock "cinder-afe0c065-28e4-40f1-b9c4-fb593161033a-delete_snapshot" released by "delete_snapshot" :: held 2.135s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:45:13 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 11:45:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:45:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:45:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:45:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:45:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:45:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:45:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.103s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:45:14 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:45:14 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-5e896f4e-33ac-4235-a50c-db6abe042596 tempest-CinderUnicodeTest-254508286 None] Acquiring lock "cinder-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:45:15 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-5e896f4e-33ac-4235-a50c-db6abe042596 tempest-CinderUnicodeTest-254508286 None] Lock "cinder-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0-delete_volume" acquired by "delete_volume" :: waited 0.107s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:45:15 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-5e896f4e-33ac-4235-a50c-db6abe042596 tempest-CinderUnicodeTest-254508286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:45:15 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-5e896f4e-33ac-4235-a50c-db6abe042596 tempest-CinderUnicodeTest-254508286 None] Acquiring lock "cinder-quobyte-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:45:15 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-5e896f4e-33ac-4235-a50c-db6abe042596 tempest-CinderUnicodeTest-254508286 None] Lock "cinder-quobyte-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0" acquired by "delete_volume" :: waited 0.013s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:45:15 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[508c21e0-f87b-4e9e-bccd-2bc6f56d472f]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:45:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5e896f4e-33ac-4235-a50c-db6abe042596 tempest-CinderUnicodeTest-254508286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:45:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5e896f4e-33ac-4235-a50c-db6abe042596 tempest-CinderUnicodeTest-254508286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0" returned: 0 in 0.711s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:45:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5e896f4e-33ac-4235-a50c-db6abe042596 tempest-CinderUnicodeTest-254508286 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:45:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5e896f4e-33ac-4235-a50c-db6abe042596 tempest-CinderUnicodeTest-254508286 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0" returned: 0 in 0.152s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:45:16 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-5e896f4e-33ac-4235-a50c-db6abe042596 tempest-CinderUnicodeTest-254508286 None] Lock "cinder-quobyte-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0" released by "delete_volume" :: held 1.086s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:45:16 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-5e896f4e-33ac-4235-a50c-db6abe042596 tempest-CinderUnicodeTest-254508286 None] Created reservations ['ea6e5508-cfb1-4565-9734-2b61e29be008', 'eadfb570-ddfd-490c-b7f3-d6f1183125d7', '3683833f-58cf-4bf6-a4c1-52ba4b9d6067', '85238e85-9153-46fa-9a5d-716a3935d9ff'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:45:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-5e896f4e-33ac-4235-a50c-db6abe042596 tempest-CinderUnicodeTest-254508286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:45:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-5e896f4e-33ac-4235-a50c-db6abe042596 tempest-CinderUnicodeTest-254508286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:45:16 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-5e896f4e-33ac-4235-a50c-db6abe042596 tempest-CinderUnicodeTest-254508286 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:45:16 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-5e896f4e-33ac-4235-a50c-db6abe042596 tempest-CinderUnicodeTest-254508286 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:45:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-5e896f4e-33ac-4235-a50c-db6abe042596 tempest-CinderUnicodeTest-254508286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:45:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5e896f4e-33ac-4235-a50c-db6abe042596 tempest-CinderUnicodeTest-254508286 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:45:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5e896f4e-33ac-4235-a50c-db6abe042596 tempest-CinderUnicodeTest-254508286 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.164s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:45:17 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-5e896f4e-33ac-4235-a50c-db6abe042596 tempest-CinderUnicodeTest-254508286 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:45:17 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-5e896f4e-33ac-4235-a50c-db6abe042596 tempest-CinderUnicodeTest-254508286 None] Deleted volume successfully.
Sep 18 11:45:17 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0366cf33-81e6-446b-85d7-72647c0f46cc tempest-CinderUnicodeTest-254508286 None] Acquiring lock "cinder-4ae357fc-d53e-483d-9bdf-04cdfea58642-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:45:17 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-5e896f4e-33ac-4235-a50c-db6abe042596 tempest-CinderUnicodeTest-254508286 None] Lock "cinder-d3431c96-5dfb-4434-8dfc-6bfdc3e647b0-delete_volume" released by "delete_volume" :: held 2.717s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:45:17 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0366cf33-81e6-446b-85d7-72647c0f46cc tempest-CinderUnicodeTest-254508286 None] Lock "cinder-4ae357fc-d53e-483d-9bdf-04cdfea58642-delete_volume" acquired by "delete_volume" :: waited 0.169s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:45:18 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-0366cf33-81e6-446b-85d7-72647c0f46cc tempest-CinderUnicodeTest-254508286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:45:18 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0366cf33-81e6-446b-85d7-72647c0f46cc tempest-CinderUnicodeTest-254508286 None] Acquiring lock "cinder-quobyte-4ae357fc-d53e-483d-9bdf-04cdfea58642" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:45:18 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0366cf33-81e6-446b-85d7-72647c0f46cc tempest-CinderUnicodeTest-254508286 None] Lock "cinder-quobyte-4ae357fc-d53e-483d-9bdf-04cdfea58642" acquired by "delete_volume" :: waited 0.016s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:45:18 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52d8409-d333-41b9-a388-c4e3eee1490c]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:45:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0366cf33-81e6-446b-85d7-72647c0f46cc tempest-CinderUnicodeTest-254508286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ae357fc-d53e-483d-9bdf-04cdfea58642 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:45:19 devstack quobyte-client[83193]: System call of process 92611 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:45:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0366cf33-81e6-446b-85d7-72647c0f46cc tempest-CinderUnicodeTest-254508286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ae357fc-d53e-483d-9bdf-04cdfea58642" returned: 0 in 1.138s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:45:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0366cf33-81e6-446b-85d7-72647c0f46cc tempest-CinderUnicodeTest-254508286 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ae357fc-d53e-483d-9bdf-04cdfea58642 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:45:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0366cf33-81e6-446b-85d7-72647c0f46cc tempest-CinderUnicodeTest-254508286 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ae357fc-d53e-483d-9bdf-04cdfea58642" returned: 0 in 0.206s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:45:19 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0366cf33-81e6-446b-85d7-72647c0f46cc tempest-CinderUnicodeTest-254508286 None] Lock "cinder-quobyte-4ae357fc-d53e-483d-9bdf-04cdfea58642" released by "delete_volume" :: held 1.618s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:45:20 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-0366cf33-81e6-446b-85d7-72647c0f46cc tempest-CinderUnicodeTest-254508286 None] Created reservations ['0570e6a6-f977-4d23-b179-ed6d5cd03f28', 'd3973cd6-56da-4751-b23b-0d15637a7d33', '53aaa2c5-3bf6-4072-9101-97fb9093765d', 'b3ba1d86-45f9-4b43-9f0f-22674d5e35f6'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:45:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0366cf33-81e6-446b-85d7-72647c0f46cc tempest-CinderUnicodeTest-254508286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:45:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0366cf33-81e6-446b-85d7-72647c0f46cc tempest-CinderUnicodeTest-254508286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:45:20 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-0366cf33-81e6-446b-85d7-72647c0f46cc tempest-CinderUnicodeTest-254508286 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:45:20 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-0366cf33-81e6-446b-85d7-72647c0f46cc tempest-CinderUnicodeTest-254508286 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:45:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0366cf33-81e6-446b-85d7-72647c0f46cc tempest-CinderUnicodeTest-254508286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:45:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0366cf33-81e6-446b-85d7-72647c0f46cc tempest-CinderUnicodeTest-254508286 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:45:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0366cf33-81e6-446b-85d7-72647c0f46cc tempest-CinderUnicodeTest-254508286 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.288s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:45:20 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-0366cf33-81e6-446b-85d7-72647c0f46cc tempest-CinderUnicodeTest-254508286 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:45:20 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-0366cf33-81e6-446b-85d7-72647c0f46cc tempest-CinderUnicodeTest-254508286 None] Deleted volume successfully.
Sep 18 11:45:21 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0366cf33-81e6-446b-85d7-72647c0f46cc tempest-CinderUnicodeTest-254508286 None] Lock "cinder-4ae357fc-d53e-483d-9bdf-04cdfea58642-delete_volume" released by "delete_volume" :: held 3.597s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:45:30 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:UPDATE=33,cinder:DELETE=1,cinder:SELECT=17,cinder:INSERT=7 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:45:31 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=18,cinder:UPDATE=19,cinder:DELETE=4,cinder:INSERT=5 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:45:57 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-08330a77-6ba4-42c6-aeb2-8f0dacefbd79 req-258b35ec-2d99-4cae-aeca-510f8a0567a2 tempest-AttachVolumeShelveTestJSON-1847875693 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:45:57 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-08330a77-6ba4-42c6-aeb2-8f0dacefbd79 req-258b35ec-2d99-4cae-aeca-510f8a0567a2 tempest-AttachVolumeShelveTestJSON-1847875693 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:45:57 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-08330a77-6ba4-42c6-aeb2-8f0dacefbd79 req-258b35ec-2d99-4cae-aeca-510f8a0567a2 tempest-AttachVolumeShelveTestJSON-1847875693 None] Terminate volume connection completed successfully.
Sep 18 11:45:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-08330a77-6ba4-42c6-aeb2-8f0dacefbd79 req-258b35ec-2d99-4cae-aeca-510f8a0567a2 tempest-AttachVolumeShelveTestJSON-1847875693 None] Deleting attachment 22caa9c6-5ce8-4140-809f-0f2a32e32524. {{(pid=83176) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 11:46:07 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:46:07 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:46:13 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 11:46:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:46:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:46:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:46:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:46:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:46:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:46:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.095s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:46:13 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:46:43 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:46:43 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:UPDATE=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:46:44 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-6c4478ca-9167-4436-9f08-3e53fe5e70f3 tempest-AttachVolumeNegativeTest-652039892 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:46:44 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c4478ca-9167-4436-9f08-3e53fe5e70f3 tempest-AttachVolumeNegativeTest-652039892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:46:44 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-6c4478ca-9167-4436-9f08-3e53fe5e70f3 tempest-AttachVolumeNegativeTest-652039892 None] Flow 'volume_create_manager' (d51dcc17-ac08-462e-8c3a-a520743da230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:46:44 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-6c4478ca-9167-4436-9f08-3e53fe5e70f3 tempest-AttachVolumeNegativeTest-652039892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7ae2ad9-ae62-48d7-9245-41a7a77d9bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:46:44 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-6c4478ca-9167-4436-9f08-3e53fe5e70f3 tempest-AttachVolumeNegativeTest-652039892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7ae2ad9-ae62-48d7-9245-41a7a77d9bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-214260641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59f786b0-dc91-4191-bc7d-25590f97dc2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a05d56cebf4a648f8e1448c266b3a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:46:44Z,use_quota=True,user_id='601cfe954e21466cb2aa683fe69a2b53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:46:44 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-6c4478ca-9167-4436-9f08-3e53fe5e70f3 tempest-AttachVolumeNegativeTest-652039892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a77b980e-83ad-42f2-b3c8-f6589a87fb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:46:44 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-6c4478ca-9167-4436-9f08-3e53fe5e70f3 tempest-AttachVolumeNegativeTest-652039892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a77b980e-83ad-42f2-b3c8-f6589a87fb89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:46:44 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-6c4478ca-9167-4436-9f08-3e53fe5e70f3 tempest-AttachVolumeNegativeTest-652039892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (690bf0f8-e79a-487f-a438-381908b9f9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:46:44 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-6c4478ca-9167-4436-9f08-3e53fe5e70f3 tempest-AttachVolumeNegativeTest-652039892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (690bf0f8-e79a-487f-a438-381908b9f9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59f786b0-dc91-4191-bc7d-25590f97dc2a', 'volume_name': 'volume-59f786b0-dc91-4191-bc7d-25590f97dc2a', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:46:44 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-6c4478ca-9167-4436-9f08-3e53fe5e70f3 tempest-AttachVolumeNegativeTest-652039892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9e4474b-bcd2-4ec9-886b-35a9352ed356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:46:44 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-6c4478ca-9167-4436-9f08-3e53fe5e70f3 tempest-AttachVolumeNegativeTest-652039892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9e4474b-bcd2-4ec9-886b-35a9352ed356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:46:44 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-6c4478ca-9167-4436-9f08-3e53fe5e70f3 tempest-AttachVolumeNegativeTest-652039892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e01128ec-eebb-4c44-8602-353dfbd69738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:46:44 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-6c4478ca-9167-4436-9f08-3e53fe5e70f3 tempest-AttachVolumeNegativeTest-652039892 None] Volume 59f786b0-dc91-4191-bc7d-25590f97dc2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59f786b0-dc91-4191-bc7d-25590f97dc2a', 'volume_size': 1}
Sep 18 11:46:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-6c4478ca-9167-4436-9f08-3e53fe5e70f3 tempest-AttachVolumeNegativeTest-652039892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:46:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-6c4478ca-9167-4436-9f08-3e53fe5e70f3 tempest-AttachVolumeNegativeTest-652039892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:46:44 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-6c4478ca-9167-4436-9f08-3e53fe5e70f3 tempest-AttachVolumeNegativeTest-652039892 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-214260641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59f786b0-dc91-4191-bc7d-25590f97dc2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a05d56cebf4a648f8e1448c266b3a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:46:44Z,use_quota=True,user_id='601cfe954e21466cb2aa683fe69a2b53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:46:44 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-6c4478ca-9167-4436-9f08-3e53fe5e70f3 tempest-AttachVolumeNegativeTest-652039892 None] Creating volume 59f786b0-dc91-4191-bc7d-25590f97dc2a {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:46:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-6c4478ca-9167-4436-9f08-3e53fe5e70f3 tempest-AttachVolumeNegativeTest-652039892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:46:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-6c4478ca-9167-4436-9f08-3e53fe5e70f3 tempest-AttachVolumeNegativeTest-652039892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:46:44 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-6c4478ca-9167-4436-9f08-3e53fe5e70f3 tempest-AttachVolumeNegativeTest-652039892 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:46:44 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-6c4478ca-9167-4436-9f08-3e53fe5e70f3 tempest-AttachVolumeNegativeTest-652039892 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:46:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-6c4478ca-9167-4436-9f08-3e53fe5e70f3 tempest-AttachVolumeNegativeTest-652039892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:46:44 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-6c4478ca-9167-4436-9f08-3e53fe5e70f3 tempest-AttachVolumeNegativeTest-652039892 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:46:44 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-6c4478ca-9167-4436-9f08-3e53fe5e70f3 tempest-AttachVolumeNegativeTest-652039892 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:46:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6c4478ca-9167-4436-9f08-3e53fe5e70f3 tempest-AttachVolumeNegativeTest-652039892 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-59f786b0-dc91-4191-bc7d-25590f97dc2a 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:46:44 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=55, name=volume-59f786b0-dc91-4191-bc7d-25590f97dc2a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:46:45 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6c4478ca-9167-4436-9f08-3e53fe5e70f3 tempest-AttachVolumeNegativeTest-652039892 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-59f786b0-dc91-4191-bc7d-25590f97dc2a 1073741824" returned: 0 in 0.527s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:46:45 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6c4478ca-9167-4436-9f08-3e53fe5e70f3 tempest-AttachVolumeNegativeTest-652039892 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-59f786b0-dc91-4191-bc7d-25590f97dc2a {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:46:45 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6c4478ca-9167-4436-9f08-3e53fe5e70f3 tempest-AttachVolumeNegativeTest-652039892 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-59f786b0-dc91-4191-bc7d-25590f97dc2a" returned: 0 in 0.114s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:46:45 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-6c4478ca-9167-4436-9f08-3e53fe5e70f3 tempest-AttachVolumeNegativeTest-652039892 None] <== create_volume: return (760ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:46:45 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-6c4478ca-9167-4436-9f08-3e53fe5e70f3 tempest-AttachVolumeNegativeTest-652039892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:46:45 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-6c4478ca-9167-4436-9f08-3e53fe5e70f3 tempest-AttachVolumeNegativeTest-652039892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e01128ec-eebb-4c44-8602-353dfbd69738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59f786b0-dc91-4191-bc7d-25590f97dc2a', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:46:45 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-6c4478ca-9167-4436-9f08-3e53fe5e70f3 tempest-AttachVolumeNegativeTest-652039892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (086af28a-063b-4cf2-adbc-224cbbd82834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:46:45 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-6c4478ca-9167-4436-9f08-3e53fe5e70f3 tempest-AttachVolumeNegativeTest-652039892 None] Volume volume-59f786b0-dc91-4191-bc7d-25590f97dc2a (59f786b0-dc91-4191-bc7d-25590f97dc2a): created successfully
Sep 18 11:46:45 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-6c4478ca-9167-4436-9f08-3e53fe5e70f3 tempest-AttachVolumeNegativeTest-652039892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (086af28a-063b-4cf2-adbc-224cbbd82834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:46:45 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-6c4478ca-9167-4436-9f08-3e53fe5e70f3 tempest-AttachVolumeNegativeTest-652039892 None] Flow 'volume_create_manager' (d51dcc17-ac08-462e-8c3a-a520743da230) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:46:45 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-6c4478ca-9167-4436-9f08-3e53fe5e70f3 tempest-AttachVolumeNegativeTest-652039892 None] Created volume successfully.
Sep 18 11:46:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-a50f5e44-7970-455a-938f-ad8724012d26 req-452fddf8-652f-4ebe-8377-ebc6699dbe6e tempest-AttachVolumeNegativeTest-652039892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:46:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-a50f5e44-7970-455a-938f-ad8724012d26 req-452fddf8-652f-4ebe-8377-ebc6699dbe6e tempest-AttachVolumeNegativeTest-652039892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:46:50 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[90454f6e-ccb6-48fe-adf1-21029064e503]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:46:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-a50f5e44-7970-455a-938f-ad8724012d26 req-452fddf8-652f-4ebe-8377-ebc6699dbe6e tempest-AttachVolumeNegativeTest-652039892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-59f786b0-dc91-4191-bc7d-25590f97dc2a {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:46:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-a50f5e44-7970-455a-938f-ad8724012d26 req-452fddf8-652f-4ebe-8377-ebc6699dbe6e tempest-AttachVolumeNegativeTest-652039892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-59f786b0-dc91-4191-bc7d-25590f97dc2a" returned: 0 in 0.526s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:46:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-a50f5e44-7970-455a-938f-ad8724012d26 req-452fddf8-652f-4ebe-8377-ebc6699dbe6e tempest-AttachVolumeNegativeTest-652039892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.596s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:46:51 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-a50f5e44-7970-455a-938f-ad8724012d26 req-452fddf8-652f-4ebe-8377-ebc6699dbe6e tempest-AttachVolumeNegativeTest-652039892 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8', 'name': 'volume-59f786b0-dc91-4191-bc7d-25590f97dc2a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '29136937-616c-4bc6-b0cb-6837846fe8e0', 'enforce_multipath': True} {{(pid=83176) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 11:46:51 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-a50f5e44-7970-455a-938f-ad8724012d26 req-452fddf8-652f-4ebe-8377-ebc6699dbe6e tempest-AttachVolumeNegativeTest-652039892 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:46:51 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-a50f5e44-7970-455a-938f-ad8724012d26 req-452fddf8-652f-4ebe-8377-ebc6699dbe6e tempest-AttachVolumeNegativeTest-652039892 None] attachment_update completed successfully.
Sep 18 11:47:01 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:47:01 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:UPDATE=3,cinder:DELETE=1,cinder:SELECT=6 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:47:13 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 11:47:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:47:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:47:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:47:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:47:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:47:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:47:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.094s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:47:13 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:47:20 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-aa3efc3d-f609-4738-90ae-fc7a37bf6771 req-075357e8-27fd-47a9-b266-539f44e0088a tempest-AttachVolumeNegativeTest-652039892 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:47:20 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-aa3efc3d-f609-4738-90ae-fc7a37bf6771 req-075357e8-27fd-47a9-b266-539f44e0088a tempest-AttachVolumeNegativeTest-652039892 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:47:20 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-aa3efc3d-f609-4738-90ae-fc7a37bf6771 req-075357e8-27fd-47a9-b266-539f44e0088a tempest-AttachVolumeNegativeTest-652039892 None] Terminate volume connection completed successfully.
Sep 18 11:47:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-aa3efc3d-f609-4738-90ae-fc7a37bf6771 req-075357e8-27fd-47a9-b266-539f44e0088a tempest-AttachVolumeNegativeTest-652039892 None] Deleting attachment 29136937-616c-4bc6-b0cb-6837846fe8e0. {{(pid=83176) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 11:47:30 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:47:30 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:47:34 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ecfae43f-b057-4cff-8949-040da1634286 tempest-AttachVolumeNegativeTest-652039892 None] Acquiring lock "cinder-59f786b0-dc91-4191-bc7d-25590f97dc2a-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:47:34 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ecfae43f-b057-4cff-8949-040da1634286 tempest-AttachVolumeNegativeTest-652039892 None] Lock "cinder-59f786b0-dc91-4191-bc7d-25590f97dc2a-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:47:34 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-ecfae43f-b057-4cff-8949-040da1634286 tempest-AttachVolumeNegativeTest-652039892 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:47:34 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ecfae43f-b057-4cff-8949-040da1634286 tempest-AttachVolumeNegativeTest-652039892 None] Acquiring lock "cinder-quobyte-59f786b0-dc91-4191-bc7d-25590f97dc2a" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:47:34 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ecfae43f-b057-4cff-8949-040da1634286 tempest-AttachVolumeNegativeTest-652039892 None] Lock "cinder-quobyte-59f786b0-dc91-4191-bc7d-25590f97dc2a" acquired by "delete_volume" :: waited 0.022s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:47:34 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e308875d-a9c9-49d0-a970-b4a67b7b13ca]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:47:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ecfae43f-b057-4cff-8949-040da1634286 tempest-AttachVolumeNegativeTest-652039892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-59f786b0-dc91-4191-bc7d-25590f97dc2a {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:47:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ecfae43f-b057-4cff-8949-040da1634286 tempest-AttachVolumeNegativeTest-652039892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-59f786b0-dc91-4191-bc7d-25590f97dc2a" returned: 0 in 0.620s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:47:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ecfae43f-b057-4cff-8949-040da1634286 tempest-AttachVolumeNegativeTest-652039892 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-59f786b0-dc91-4191-bc7d-25590f97dc2a {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:47:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ecfae43f-b057-4cff-8949-040da1634286 tempest-AttachVolumeNegativeTest-652039892 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-59f786b0-dc91-4191-bc7d-25590f97dc2a" returned: 0 in 0.089s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:47:35 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ecfae43f-b057-4cff-8949-040da1634286 tempest-AttachVolumeNegativeTest-652039892 None] Lock "cinder-quobyte-59f786b0-dc91-4191-bc7d-25590f97dc2a" released by "delete_volume" :: held 0.901s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:47:35 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-ecfae43f-b057-4cff-8949-040da1634286 tempest-AttachVolumeNegativeTest-652039892 None] Created reservations ['bcbea26e-3bd5-497e-9814-4e2176a7ca29', '11e2aec5-d0c7-40f2-a4b9-baf52d4a1e0c', 'e83f470d-e943-49fa-b641-71615a8c01e3', '1a6b65c6-5c86-42f1-8756-86e11c549e3e'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:47:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ecfae43f-b057-4cff-8949-040da1634286 tempest-AttachVolumeNegativeTest-652039892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:47:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ecfae43f-b057-4cff-8949-040da1634286 tempest-AttachVolumeNegativeTest-652039892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:47:36 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-ecfae43f-b057-4cff-8949-040da1634286 tempest-AttachVolumeNegativeTest-652039892 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:47:36 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-ecfae43f-b057-4cff-8949-040da1634286 tempest-AttachVolumeNegativeTest-652039892 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:47:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ecfae43f-b057-4cff-8949-040da1634286 tempest-AttachVolumeNegativeTest-652039892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:47:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ecfae43f-b057-4cff-8949-040da1634286 tempest-AttachVolumeNegativeTest-652039892 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:47:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ecfae43f-b057-4cff-8949-040da1634286 tempest-AttachVolumeNegativeTest-652039892 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.109s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:47:36 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-ecfae43f-b057-4cff-8949-040da1634286 tempest-AttachVolumeNegativeTest-652039892 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:47:36 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-ecfae43f-b057-4cff-8949-040da1634286 tempest-AttachVolumeNegativeTest-652039892 None] Deleted volume successfully.
Sep 18 11:47:36 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ecfae43f-b057-4cff-8949-040da1634286 tempest-AttachVolumeNegativeTest-652039892 None] Lock "cinder-59f786b0-dc91-4191-bc7d-25590f97dc2a-delete_volume" released by "delete_volume" :: held 2.267s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:47:36 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-b427a393-6257-47a5-b976-6bc6aec10c48 tempest-AttachVolumeNegativeTest-652039892 None] Acquiring lock "cinder-676aee41-6692-408d-9c94-92c2698e6004-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:47:37 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-b427a393-6257-47a5-b976-6bc6aec10c48 tempest-AttachVolumeNegativeTest-652039892 None] Lock "cinder-676aee41-6692-408d-9c94-92c2698e6004-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:47:37 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-b427a393-6257-47a5-b976-6bc6aec10c48 tempest-AttachVolumeNegativeTest-652039892 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:47:37 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-b427a393-6257-47a5-b976-6bc6aec10c48 tempest-AttachVolumeNegativeTest-652039892 None] Acquiring lock "cinder-quobyte-676aee41-6692-408d-9c94-92c2698e6004" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:47:37 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-b427a393-6257-47a5-b976-6bc6aec10c48 tempest-AttachVolumeNegativeTest-652039892 None] Lock "cinder-quobyte-676aee41-6692-408d-9c94-92c2698e6004" acquired by "delete_volume" :: waited 0.010s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:47:37 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b47750-7e48-48c7-995a-30555c922547]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:47:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b427a393-6257-47a5-b976-6bc6aec10c48 tempest-AttachVolumeNegativeTest-652039892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-676aee41-6692-408d-9c94-92c2698e6004 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:47:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b427a393-6257-47a5-b976-6bc6aec10c48 tempest-AttachVolumeNegativeTest-652039892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-676aee41-6692-408d-9c94-92c2698e6004" returned: 0 in 0.516s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:47:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b427a393-6257-47a5-b976-6bc6aec10c48 tempest-AttachVolumeNegativeTest-652039892 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-676aee41-6692-408d-9c94-92c2698e6004 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:47:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b427a393-6257-47a5-b976-6bc6aec10c48 tempest-AttachVolumeNegativeTest-652039892 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-676aee41-6692-408d-9c94-92c2698e6004" returned: 0 in 0.111s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:47:38 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-b427a393-6257-47a5-b976-6bc6aec10c48 tempest-AttachVolumeNegativeTest-652039892 None] Lock "cinder-quobyte-676aee41-6692-408d-9c94-92c2698e6004" released by "delete_volume" :: held 0.824s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:47:38 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-b427a393-6257-47a5-b976-6bc6aec10c48 tempest-AttachVolumeNegativeTest-652039892 None] Created reservations ['3ce6caf2-bd71-4515-81c8-fe6d253e44db', '5436bc12-5513-43c8-91f1-08732221bbbf', '2cc03430-5af7-4712-aeae-c7def63d6ca8', 'c29f7831-e792-4925-a395-336e4c2ae645'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:47:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-b427a393-6257-47a5-b976-6bc6aec10c48 tempest-AttachVolumeNegativeTest-652039892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:47:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-b427a393-6257-47a5-b976-6bc6aec10c48 tempest-AttachVolumeNegativeTest-652039892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:47:38 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-b427a393-6257-47a5-b976-6bc6aec10c48 tempest-AttachVolumeNegativeTest-652039892 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:47:38 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-b427a393-6257-47a5-b976-6bc6aec10c48 tempest-AttachVolumeNegativeTest-652039892 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:47:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-b427a393-6257-47a5-b976-6bc6aec10c48 tempest-AttachVolumeNegativeTest-652039892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:47:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b427a393-6257-47a5-b976-6bc6aec10c48 tempest-AttachVolumeNegativeTest-652039892 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:47:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b427a393-6257-47a5-b976-6bc6aec10c48 tempest-AttachVolumeNegativeTest-652039892 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.119s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:47:38 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-b427a393-6257-47a5-b976-6bc6aec10c48 tempest-AttachVolumeNegativeTest-652039892 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:47:38 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-b427a393-6257-47a5-b976-6bc6aec10c48 tempest-AttachVolumeNegativeTest-652039892 None] Deleted volume successfully.
Sep 18 11:47:38 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-b427a393-6257-47a5-b976-6bc6aec10c48 tempest-AttachVolumeNegativeTest-652039892 None] Lock "cinder-676aee41-6692-408d-9c94-92c2698e6004-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:47:39 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-b10113cb-27e9-4cbb-a7d3-740abe1009d3 tempest-AttachVolumeNegativeTest-652039892 None] Acquiring lock "cinder-5b84b74c-432d-450c-b80a-00b3a9652c48-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:47:39 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-b10113cb-27e9-4cbb-a7d3-740abe1009d3 tempest-AttachVolumeNegativeTest-652039892 None] Lock "cinder-5b84b74c-432d-450c-b80a-00b3a9652c48-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:47:39 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-b10113cb-27e9-4cbb-a7d3-740abe1009d3 tempest-AttachVolumeNegativeTest-652039892 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:47:39 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-b10113cb-27e9-4cbb-a7d3-740abe1009d3 tempest-AttachVolumeNegativeTest-652039892 None] Acquiring lock "cinder-quobyte-5b84b74c-432d-450c-b80a-00b3a9652c48" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:47:39 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-b10113cb-27e9-4cbb-a7d3-740abe1009d3 tempest-AttachVolumeNegativeTest-652039892 None] Lock "cinder-quobyte-5b84b74c-432d-450c-b80a-00b3a9652c48" acquired by "delete_volume" :: waited 0.016s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:47:40 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3268fd90-3ff6-417a-9913-0bd3dbdbc523]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:47:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b10113cb-27e9-4cbb-a7d3-740abe1009d3 tempest-AttachVolumeNegativeTest-652039892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5b84b74c-432d-450c-b80a-00b3a9652c48 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:47:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b10113cb-27e9-4cbb-a7d3-740abe1009d3 tempest-AttachVolumeNegativeTest-652039892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5b84b74c-432d-450c-b80a-00b3a9652c48" returned: 0 in 0.653s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:47:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b10113cb-27e9-4cbb-a7d3-740abe1009d3 tempest-AttachVolumeNegativeTest-652039892 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5b84b74c-432d-450c-b80a-00b3a9652c48 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:47:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b10113cb-27e9-4cbb-a7d3-740abe1009d3 tempest-AttachVolumeNegativeTest-652039892 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5b84b74c-432d-450c-b80a-00b3a9652c48" returned: 0 in 0.194s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:47:41 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-b10113cb-27e9-4cbb-a7d3-740abe1009d3 tempest-AttachVolumeNegativeTest-652039892 None] Lock "cinder-quobyte-5b84b74c-432d-450c-b80a-00b3a9652c48" released by "delete_volume" :: held 1.124s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:47:41 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-b10113cb-27e9-4cbb-a7d3-740abe1009d3 tempest-AttachVolumeNegativeTest-652039892 None] Created reservations ['a86f0a14-1a44-40ff-99c9-1222a53a43a2', '19e1963e-8506-4eae-8c65-74b7089240c6', 'f051aa2e-5e77-4c19-a6bd-0eb98e7dd554', '7e1d1884-a764-441d-ad06-b3ec7a66c67e'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:47:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-b10113cb-27e9-4cbb-a7d3-740abe1009d3 tempest-AttachVolumeNegativeTest-652039892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:47:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-b10113cb-27e9-4cbb-a7d3-740abe1009d3 tempest-AttachVolumeNegativeTest-652039892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:47:41 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-b10113cb-27e9-4cbb-a7d3-740abe1009d3 tempest-AttachVolumeNegativeTest-652039892 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:47:41 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-b10113cb-27e9-4cbb-a7d3-740abe1009d3 tempest-AttachVolumeNegativeTest-652039892 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:47:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-b10113cb-27e9-4cbb-a7d3-740abe1009d3 tempest-AttachVolumeNegativeTest-652039892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:47:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b10113cb-27e9-4cbb-a7d3-740abe1009d3 tempest-AttachVolumeNegativeTest-652039892 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:47:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b10113cb-27e9-4cbb-a7d3-740abe1009d3 tempest-AttachVolumeNegativeTest-652039892 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.106s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:47:41 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-b10113cb-27e9-4cbb-a7d3-740abe1009d3 tempest-AttachVolumeNegativeTest-652039892 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:47:41 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-b10113cb-27e9-4cbb-a7d3-740abe1009d3 tempest-AttachVolumeNegativeTest-652039892 None] Deleted volume successfully.
Sep 18 11:47:42 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-b10113cb-27e9-4cbb-a7d3-740abe1009d3 tempest-AttachVolumeNegativeTest-652039892 None] Lock "cinder-5b84b74c-432d-450c-b80a-00b3a9652c48-delete_volume" released by "delete_volume" :: held 2.250s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:47:46 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-64b6113c-3aed-44de-8c29-36fa0a5fbd63 tempest-AttachVolumeShelveTestJSON-1847875693 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:47:46 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-64b6113c-3aed-44de-8c29-36fa0a5fbd63 tempest-AttachVolumeShelveTestJSON-1847875693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:47:46 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-64b6113c-3aed-44de-8c29-36fa0a5fbd63 tempest-AttachVolumeShelveTestJSON-1847875693 None] Flow 'volume_create_manager' (fb9ea2d8-0533-4d74-94b3-23c8723797af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:47:46 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-64b6113c-3aed-44de-8c29-36fa0a5fbd63 tempest-AttachVolumeShelveTestJSON-1847875693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12cf1c28-faa3-4c85-81a5-3cb8b68e68fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:47:47 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-64b6113c-3aed-44de-8c29-36fa0a5fbd63 tempest-AttachVolumeShelveTestJSON-1847875693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12cf1c28-faa3-4c85-81a5-3cb8b68e68fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:47:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-364843504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d09717b4-adeb-48ad-bdd3-9f8e9eafef74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e15c46d6f5346c28943e8c739d07ec0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:47:47Z,use_quota=True,user_id='24dc058fb82f4189809476a527afe7e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:47:47 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-64b6113c-3aed-44de-8c29-36fa0a5fbd63 tempest-AttachVolumeShelveTestJSON-1847875693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a0a1f52-7b78-41ee-9230-2572d5a02de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:47:47 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-64b6113c-3aed-44de-8c29-36fa0a5fbd63 tempest-AttachVolumeShelveTestJSON-1847875693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a0a1f52-7b78-41ee-9230-2572d5a02de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:47:47 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-64b6113c-3aed-44de-8c29-36fa0a5fbd63 tempest-AttachVolumeShelveTestJSON-1847875693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d7baaa6-e5c6-4d84-b0d3-fa5208697d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:47:47 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-64b6113c-3aed-44de-8c29-36fa0a5fbd63 tempest-AttachVolumeShelveTestJSON-1847875693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d7baaa6-e5c6-4d84-b0d3-fa5208697d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd09717b4-adeb-48ad-bdd3-9f8e9eafef74', 'volume_name': 'volume-d09717b4-adeb-48ad-bdd3-9f8e9eafef74', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:47:47 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-64b6113c-3aed-44de-8c29-36fa0a5fbd63 tempest-AttachVolumeShelveTestJSON-1847875693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (794673b0-cb45-422a-a667-d50e4af8cbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:47:47 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-64b6113c-3aed-44de-8c29-36fa0a5fbd63 tempest-AttachVolumeShelveTestJSON-1847875693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (794673b0-cb45-422a-a667-d50e4af8cbac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:47:47 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-64b6113c-3aed-44de-8c29-36fa0a5fbd63 tempest-AttachVolumeShelveTestJSON-1847875693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee963328-40c7-4ac7-a381-1579646046a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:47:47 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-64b6113c-3aed-44de-8c29-36fa0a5fbd63 tempest-AttachVolumeShelveTestJSON-1847875693 None] Volume d09717b4-adeb-48ad-bdd3-9f8e9eafef74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d09717b4-adeb-48ad-bdd3-9f8e9eafef74', 'volume_size': 1}
Sep 18 11:47:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-64b6113c-3aed-44de-8c29-36fa0a5fbd63 tempest-AttachVolumeShelveTestJSON-1847875693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:47:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-64b6113c-3aed-44de-8c29-36fa0a5fbd63 tempest-AttachVolumeShelveTestJSON-1847875693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:47:47 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-64b6113c-3aed-44de-8c29-36fa0a5fbd63 tempest-AttachVolumeShelveTestJSON-1847875693 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:47:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-364843504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d09717b4-adeb-48ad-bdd3-9f8e9eafef74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e15c46d6f5346c28943e8c739d07ec0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:47:47Z,use_quota=True,user_id='24dc058fb82f4189809476a527afe7e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:47:47 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-64b6113c-3aed-44de-8c29-36fa0a5fbd63 tempest-AttachVolumeShelveTestJSON-1847875693 None] Creating volume d09717b4-adeb-48ad-bdd3-9f8e9eafef74 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:47:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-64b6113c-3aed-44de-8c29-36fa0a5fbd63 tempest-AttachVolumeShelveTestJSON-1847875693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:47:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-64b6113c-3aed-44de-8c29-36fa0a5fbd63 tempest-AttachVolumeShelveTestJSON-1847875693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:47:47 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-64b6113c-3aed-44de-8c29-36fa0a5fbd63 tempest-AttachVolumeShelveTestJSON-1847875693 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:47:47 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-64b6113c-3aed-44de-8c29-36fa0a5fbd63 tempest-AttachVolumeShelveTestJSON-1847875693 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:47:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-64b6113c-3aed-44de-8c29-36fa0a5fbd63 tempest-AttachVolumeShelveTestJSON-1847875693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:47:47 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-64b6113c-3aed-44de-8c29-36fa0a5fbd63 tempest-AttachVolumeShelveTestJSON-1847875693 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:47:47 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-64b6113c-3aed-44de-8c29-36fa0a5fbd63 tempest-AttachVolumeShelveTestJSON-1847875693 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:47:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-64b6113c-3aed-44de-8c29-36fa0a5fbd63 tempest-AttachVolumeShelveTestJSON-1847875693 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d09717b4-adeb-48ad-bdd3-9f8e9eafef74 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:47:47 devstack quobyte-client[83193]: System call of process 93649 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:47:47 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=56, name=volume-d09717b4-adeb-48ad-bdd3-9f8e9eafef74, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:47:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-64b6113c-3aed-44de-8c29-36fa0a5fbd63 tempest-AttachVolumeShelveTestJSON-1847875693 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d09717b4-adeb-48ad-bdd3-9f8e9eafef74 1073741824" returned: 0 in 0.472s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:47:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-64b6113c-3aed-44de-8c29-36fa0a5fbd63 tempest-AttachVolumeShelveTestJSON-1847875693 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d09717b4-adeb-48ad-bdd3-9f8e9eafef74 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:47:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-64b6113c-3aed-44de-8c29-36fa0a5fbd63 tempest-AttachVolumeShelveTestJSON-1847875693 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d09717b4-adeb-48ad-bdd3-9f8e9eafef74" returned: 0 in 0.133s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:47:47 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-64b6113c-3aed-44de-8c29-36fa0a5fbd63 tempest-AttachVolumeShelveTestJSON-1847875693 None] <== create_volume: return (725ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:47:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-64b6113c-3aed-44de-8c29-36fa0a5fbd63 tempest-AttachVolumeShelveTestJSON-1847875693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:47:48 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-64b6113c-3aed-44de-8c29-36fa0a5fbd63 tempest-AttachVolumeShelveTestJSON-1847875693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee963328-40c7-4ac7-a381-1579646046a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d09717b4-adeb-48ad-bdd3-9f8e9eafef74', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:47:48 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-64b6113c-3aed-44de-8c29-36fa0a5fbd63 tempest-AttachVolumeShelveTestJSON-1847875693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aa2b1e8-73da-4515-bcc2-82b878b3e962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:47:48 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-64b6113c-3aed-44de-8c29-36fa0a5fbd63 tempest-AttachVolumeShelveTestJSON-1847875693 None] Volume volume-d09717b4-adeb-48ad-bdd3-9f8e9eafef74 (d09717b4-adeb-48ad-bdd3-9f8e9eafef74): created successfully
Sep 18 11:47:48 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-64b6113c-3aed-44de-8c29-36fa0a5fbd63 tempest-AttachVolumeShelveTestJSON-1847875693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aa2b1e8-73da-4515-bcc2-82b878b3e962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:47:48 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-64b6113c-3aed-44de-8c29-36fa0a5fbd63 tempest-AttachVolumeShelveTestJSON-1847875693 None] Flow 'volume_create_manager' (fb9ea2d8-0533-4d74-94b3-23c8723797af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:47:48 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-64b6113c-3aed-44de-8c29-36fa0a5fbd63 tempest-AttachVolumeShelveTestJSON-1847875693 None] Created volume successfully.
Sep 18 11:47:52 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-48a78fa5-f22d-42be-950b-cf75dfab2504 req-a1ca3f8e-81f1-4a19-884c-bdd1e3484251 tempest-VolumesSnapshotsTestJSON-276257537 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:47:52 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [req-48a78fa5-f22d-42be-950b-cf75dfab2504 req-a1ca3f8e-81f1-4a19-884c-bdd1e3484251 tempest-VolumesSnapshotsTestJSON-276257537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:47:52 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-48a78fa5-f22d-42be-950b-cf75dfab2504 req-a1ca3f8e-81f1-4a19-884c-bdd1e3484251 tempest-VolumesSnapshotsTestJSON-276257537 None] Flow 'volume_create_manager' (83f293ec-5bee-4440-a38a-f842918010a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:47:52 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-48a78fa5-f22d-42be-950b-cf75dfab2504 req-a1ca3f8e-81f1-4a19-884c-bdd1e3484251 tempest-VolumesSnapshotsTestJSON-276257537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4b12ff7-ccdf-4b3b-863b-3c1a9ad49013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:47:52 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-48a78fa5-f22d-42be-950b-cf75dfab2504 req-a1ca3f8e-81f1-4a19-884c-bdd1e3484251 tempest-VolumesSnapshotsTestJSON-276257537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4b12ff7-ccdf-4b3b-863b-3c1a9ad49013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1200141765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1df6152d-435c-44f7-a508-694b338cd402,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c8bf67a703145de973240b88ec4af74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:47:52Z,use_quota=True,user_id='dd7755cca736431e8c364ef294167e84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:47:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-48a78fa5-f22d-42be-950b-cf75dfab2504 req-a1ca3f8e-81f1-4a19-884c-bdd1e3484251 tempest-VolumesSnapshotsTestJSON-276257537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52ce4ae4-0a53-4031-95ef-f476438381df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:47:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-48a78fa5-f22d-42be-950b-cf75dfab2504 req-a1ca3f8e-81f1-4a19-884c-bdd1e3484251 tempest-VolumesSnapshotsTestJSON-276257537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52ce4ae4-0a53-4031-95ef-f476438381df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:47:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-48a78fa5-f22d-42be-950b-cf75dfab2504 req-a1ca3f8e-81f1-4a19-884c-bdd1e3484251 tempest-VolumesSnapshotsTestJSON-276257537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bff6fedd-2bd6-473e-ac03-2593eb87478d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:47:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-48a78fa5-f22d-42be-950b-cf75dfab2504 req-a1ca3f8e-81f1-4a19-884c-bdd1e3484251 tempest-VolumesSnapshotsTestJSON-276257537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bff6fedd-2bd6-473e-ac03-2593eb87478d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1df6152d-435c-44f7-a508-694b338cd402', 'volume_name': 'volume-1df6152d-435c-44f7-a508-694b338cd402', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:47:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-48a78fa5-f22d-42be-950b-cf75dfab2504 req-a1ca3f8e-81f1-4a19-884c-bdd1e3484251 tempest-VolumesSnapshotsTestJSON-276257537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (884ae831-5713-44ab-9dc6-5e6589ce06b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:47:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-48a78fa5-f22d-42be-950b-cf75dfab2504 req-a1ca3f8e-81f1-4a19-884c-bdd1e3484251 tempest-VolumesSnapshotsTestJSON-276257537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (884ae831-5713-44ab-9dc6-5e6589ce06b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:47:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-48a78fa5-f22d-42be-950b-cf75dfab2504 req-a1ca3f8e-81f1-4a19-884c-bdd1e3484251 tempest-VolumesSnapshotsTestJSON-276257537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (637b8fc4-82f9-4efa-bed9-1870b4407410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:47:53 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [req-48a78fa5-f22d-42be-950b-cf75dfab2504 req-a1ca3f8e-81f1-4a19-884c-bdd1e3484251 tempest-VolumesSnapshotsTestJSON-276257537 None] Volume 1df6152d-435c-44f7-a508-694b338cd402: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1df6152d-435c-44f7-a508-694b338cd402', 'volume_size': 1}
Sep 18 11:47:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-48a78fa5-f22d-42be-950b-cf75dfab2504 req-a1ca3f8e-81f1-4a19-884c-bdd1e3484251 tempest-VolumesSnapshotsTestJSON-276257537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:47:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-48a78fa5-f22d-42be-950b-cf75dfab2504 req-a1ca3f8e-81f1-4a19-884c-bdd1e3484251 tempest-VolumesSnapshotsTestJSON-276257537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:47:53 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [req-48a78fa5-f22d-42be-950b-cf75dfab2504 req-a1ca3f8e-81f1-4a19-884c-bdd1e3484251 tempest-VolumesSnapshotsTestJSON-276257537 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1200141765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1df6152d-435c-44f7-a508-694b338cd402,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c8bf67a703145de973240b88ec4af74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:47:52Z,use_quota=True,user_id='dd7755cca736431e8c364ef294167e84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:47:53 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [req-48a78fa5-f22d-42be-950b-cf75dfab2504 req-a1ca3f8e-81f1-4a19-884c-bdd1e3484251 tempest-VolumesSnapshotsTestJSON-276257537 None] Creating volume 1df6152d-435c-44f7-a508-694b338cd402 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:47:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-48a78fa5-f22d-42be-950b-cf75dfab2504 req-a1ca3f8e-81f1-4a19-884c-bdd1e3484251 tempest-VolumesSnapshotsTestJSON-276257537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:47:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-48a78fa5-f22d-42be-950b-cf75dfab2504 req-a1ca3f8e-81f1-4a19-884c-bdd1e3484251 tempest-VolumesSnapshotsTestJSON-276257537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:47:53 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [req-48a78fa5-f22d-42be-950b-cf75dfab2504 req-a1ca3f8e-81f1-4a19-884c-bdd1e3484251 tempest-VolumesSnapshotsTestJSON-276257537 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:47:53 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [req-48a78fa5-f22d-42be-950b-cf75dfab2504 req-a1ca3f8e-81f1-4a19-884c-bdd1e3484251 tempest-VolumesSnapshotsTestJSON-276257537 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:47:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-48a78fa5-f22d-42be-950b-cf75dfab2504 req-a1ca3f8e-81f1-4a19-884c-bdd1e3484251 tempest-VolumesSnapshotsTestJSON-276257537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:47:53 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [req-48a78fa5-f22d-42be-950b-cf75dfab2504 req-a1ca3f8e-81f1-4a19-884c-bdd1e3484251 tempest-VolumesSnapshotsTestJSON-276257537 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:47:53 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [req-48a78fa5-f22d-42be-950b-cf75dfab2504 req-a1ca3f8e-81f1-4a19-884c-bdd1e3484251 tempest-VolumesSnapshotsTestJSON-276257537 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:47:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-48a78fa5-f22d-42be-950b-cf75dfab2504 req-a1ca3f8e-81f1-4a19-884c-bdd1e3484251 tempest-VolumesSnapshotsTestJSON-276257537 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1df6152d-435c-44f7-a508-694b338cd402 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:47:53 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=57, name=volume-1df6152d-435c-44f7-a508-694b338cd402, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:47:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-48a78fa5-f22d-42be-950b-cf75dfab2504 req-a1ca3f8e-81f1-4a19-884c-bdd1e3484251 tempest-VolumesSnapshotsTestJSON-276257537 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1df6152d-435c-44f7-a508-694b338cd402 1073741824" returned: 0 in 0.732s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:47:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-48a78fa5-f22d-42be-950b-cf75dfab2504 req-a1ca3f8e-81f1-4a19-884c-bdd1e3484251 tempest-VolumesSnapshotsTestJSON-276257537 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1df6152d-435c-44f7-a508-694b338cd402 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:47:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-48a78fa5-f22d-42be-950b-cf75dfab2504 req-a1ca3f8e-81f1-4a19-884c-bdd1e3484251 tempest-VolumesSnapshotsTestJSON-276257537 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1df6152d-435c-44f7-a508-694b338cd402" returned: 0 in 0.140s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:47:54 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [req-48a78fa5-f22d-42be-950b-cf75dfab2504 req-a1ca3f8e-81f1-4a19-884c-bdd1e3484251 tempest-VolumesSnapshotsTestJSON-276257537 None] <== create_volume: return (987ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:47:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-48a78fa5-f22d-42be-950b-cf75dfab2504 req-a1ca3f8e-81f1-4a19-884c-bdd1e3484251 tempest-VolumesSnapshotsTestJSON-276257537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:47:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-48a78fa5-f22d-42be-950b-cf75dfab2504 req-a1ca3f8e-81f1-4a19-884c-bdd1e3484251 tempest-VolumesSnapshotsTestJSON-276257537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (637b8fc4-82f9-4efa-bed9-1870b4407410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1df6152d-435c-44f7-a508-694b338cd402', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:47:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-48a78fa5-f22d-42be-950b-cf75dfab2504 req-a1ca3f8e-81f1-4a19-884c-bdd1e3484251 tempest-VolumesSnapshotsTestJSON-276257537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdeed5c1-ec99-472d-b4bd-cc244c87f88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:47:54 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [req-48a78fa5-f22d-42be-950b-cf75dfab2504 req-a1ca3f8e-81f1-4a19-884c-bdd1e3484251 tempest-VolumesSnapshotsTestJSON-276257537 None] Volume volume-1df6152d-435c-44f7-a508-694b338cd402 (1df6152d-435c-44f7-a508-694b338cd402): created successfully
Sep 18 11:47:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-48a78fa5-f22d-42be-950b-cf75dfab2504 req-a1ca3f8e-81f1-4a19-884c-bdd1e3484251 tempest-VolumesSnapshotsTestJSON-276257537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdeed5c1-ec99-472d-b4bd-cc244c87f88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:47:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-48a78fa5-f22d-42be-950b-cf75dfab2504 req-a1ca3f8e-81f1-4a19-884c-bdd1e3484251 tempest-VolumesSnapshotsTestJSON-276257537 None] Flow 'volume_create_manager' (83f293ec-5bee-4440-a38a-f842918010a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:47:54 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-48a78fa5-f22d-42be-950b-cf75dfab2504 req-a1ca3f8e-81f1-4a19-884c-bdd1e3484251 tempest-VolumesSnapshotsTestJSON-276257537 None] Created volume successfully.
Sep 18 11:47:55 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-5dfae9d2-9c5c-460f-884e-5e113ec50d8e req-a9454c1a-80e0-4e2a-8564-be8eff100a8e tempest-VolumesSnapshotsTestJSON-276257537 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:47:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-5dfae9d2-9c5c-460f-884e-5e113ec50d8e req-a9454c1a-80e0-4e2a-8564-be8eff100a8e tempest-VolumesSnapshotsTestJSON-276257537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:47:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-5dfae9d2-9c5c-460f-884e-5e113ec50d8e req-a9454c1a-80e0-4e2a-8564-be8eff100a8e tempest-VolumesSnapshotsTestJSON-276257537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:47:55 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [req-5dfae9d2-9c5c-460f-884e-5e113ec50d8e req-a9454c1a-80e0-4e2a-8564-be8eff100a8e tempest-VolumesSnapshotsTestJSON-276257537 None] Creating offline snapshot 0d942afe-31de-45af-954f-9d313f191258 of volume 1df6152d-435c-44f7-a508-694b338cd402 {{(pid=83176) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 11:47:55 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e58f633-fc20-4f1f-9305-b88edb488f6b]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:47:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-5dfae9d2-9c5c-460f-884e-5e113ec50d8e req-a9454c1a-80e0-4e2a-8564-be8eff100a8e tempest-VolumesSnapshotsTestJSON-276257537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1df6152d-435c-44f7-a508-694b338cd402 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:47:56 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-5dfae9d2-9c5c-460f-884e-5e113ec50d8e req-a9454c1a-80e0-4e2a-8564-be8eff100a8e tempest-VolumesSnapshotsTestJSON-276257537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1df6152d-435c-44f7-a508-694b338cd402" returned: 0 in 0.491s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:47:56 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-5dfae9d2-9c5c-460f-884e-5e113ec50d8e req-a9454c1a-80e0-4e2a-8564-be8eff100a8e tempest-VolumesSnapshotsTestJSON-276257537 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1df6152d-435c-44f7-a508-694b338cd402,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1df6152d-435c-44f7-a508-694b338cd402.0d942afe-31de-45af-954f-9d313f191258 1G {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:47:56 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=58, name=volume-1df6152d-435c-44f7-a508-694b338cd402.0d942afe-31de-45af-954f-9d313f191258, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:47:56 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-5dfae9d2-9c5c-460f-884e-5e113ec50d8e req-a9454c1a-80e0-4e2a-8564-be8eff100a8e tempest-VolumesSnapshotsTestJSON-276257537 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1df6152d-435c-44f7-a508-694b338cd402,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1df6152d-435c-44f7-a508-694b338cd402.0d942afe-31de-45af-954f-9d313f191258 1G" returned: 0 in 0.284s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:47:56 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-5dfae9d2-9c5c-460f-884e-5e113ec50d8e req-a9454c1a-80e0-4e2a-8564-be8eff100a8e tempest-VolumesSnapshotsTestJSON-276257537 None] Running cmd (subprocess): qemu-img rebase -u -b volume-1df6152d-435c-44f7-a508-694b338cd402 -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1df6152d-435c-44f7-a508-694b338cd402.0d942afe-31de-45af-954f-9d313f191258 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:47:56 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-5dfae9d2-9c5c-460f-884e-5e113ec50d8e req-a9454c1a-80e0-4e2a-8564-be8eff100a8e tempest-VolumesSnapshotsTestJSON-276257537 None] CMD "qemu-img rebase -u -b volume-1df6152d-435c-44f7-a508-694b338cd402 -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1df6152d-435c-44f7-a508-694b338cd402.0d942afe-31de-45af-954f-9d313f191258" returned: 0 in 0.155s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:47:56 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [req-5dfae9d2-9c5c-460f-884e-5e113ec50d8e req-a9454c1a-80e0-4e2a-8564-be8eff100a8e tempest-VolumesSnapshotsTestJSON-276257537 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1df6152d-435c-44f7-a508-694b338cd402.0d942afe-31de-45af-954f-9d313f191258 is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 11:47:56 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-5dfae9d2-9c5c-460f-884e-5e113ec50d8e req-a9454c1a-80e0-4e2a-8564-be8eff100a8e tempest-VolumesSnapshotsTestJSON-276257537 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1df6152d-435c-44f7-a508-694b338cd402.0d942afe-31de-45af-954f-9d313f191258 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:47:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-5dfae9d2-9c5c-460f-884e-5e113ec50d8e req-a9454c1a-80e0-4e2a-8564-be8eff100a8e tempest-VolumesSnapshotsTestJSON-276257537 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1df6152d-435c-44f7-a508-694b338cd402.0d942afe-31de-45af-954f-9d313f191258" returned: 0 in 0.143s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:47:57 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [req-5dfae9d2-9c5c-460f-884e-5e113ec50d8e req-a9454c1a-80e0-4e2a-8564-be8eff100a8e tempest-VolumesSnapshotsTestJSON-276257537 None] Setting permissions: /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1df6152d-435c-44f7-a508-694b338cd402 -> 1000:1000 {{(pid=83176) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 11:47:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-5dfae9d2-9c5c-460f-884e-5e113ec50d8e req-a9454c1a-80e0-4e2a-8564-be8eff100a8e tempest-VolumesSnapshotsTestJSON-276257537 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1df6152d-435c-44f7-a508-694b338cd402 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1df6152d-435c-44f7-a508-694b338cd402.0d942afe-31de-45af-954f-9d313f191258 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:47:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-5dfae9d2-9c5c-460f-884e-5e113ec50d8e req-a9454c1a-80e0-4e2a-8564-be8eff100a8e tempest-VolumesSnapshotsTestJSON-276257537 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1df6152d-435c-44f7-a508-694b338cd402 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1df6152d-435c-44f7-a508-694b338cd402.0d942afe-31de-45af-954f-9d313f191258" returned: 0 in 0.109s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:47:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-5dfae9d2-9c5c-460f-884e-5e113ec50d8e req-a9454c1a-80e0-4e2a-8564-be8eff100a8e tempest-VolumesSnapshotsTestJSON-276257537 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1df6152d-435c-44f7-a508-694b338cd402.info {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:47:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-5dfae9d2-9c5c-460f-884e-5e113ec50d8e req-a9454c1a-80e0-4e2a-8564-be8eff100a8e tempest-VolumesSnapshotsTestJSON-276257537 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1df6152d-435c-44f7-a508-694b338cd402.info" returned: 0 in 0.090s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:47:57 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [req-5dfae9d2-9c5c-460f-884e-5e113ec50d8e req-a9454c1a-80e0-4e2a-8564-be8eff100a8e tempest-VolumesSnapshotsTestJSON-276257537 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1df6152d-435c-44f7-a508-694b338cd402.info is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 11:47:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-5dfae9d2-9c5c-460f-884e-5e113ec50d8e req-a9454c1a-80e0-4e2a-8564-be8eff100a8e tempest-VolumesSnapshotsTestJSON-276257537 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1df6152d-435c-44f7-a508-694b338cd402.info {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:47:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-5dfae9d2-9c5c-460f-884e-5e113ec50d8e req-a9454c1a-80e0-4e2a-8564-be8eff100a8e tempest-VolumesSnapshotsTestJSON-276257537 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1df6152d-435c-44f7-a508-694b338cd402.info" returned: 0 in 0.096s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:47:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-5dfae9d2-9c5c-460f-884e-5e113ec50d8e req-a9454c1a-80e0-4e2a-8564-be8eff100a8e tempest-VolumesSnapshotsTestJSON-276257537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.899s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:47:57 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-5dfae9d2-9c5c-460f-884e-5e113ec50d8e req-a9454c1a-80e0-4e2a-8564-be8eff100a8e tempest-VolumesSnapshotsTestJSON-276257537 None] Create snapshot completed successfully
Sep 18 11:47:59 devstack cinder-volume[83176]: DEBUG cinder.coordination [req-d7c52d2a-ce48-4895-8dcd-3151efbf8bfd req-78b49f61-8066-450f-a263-dc391f1e688d tempest-VolumesSnapshotsTestJSON-276257537 None] Acquiring lock "cinder-0d942afe-31de-45af-954f-9d313f191258-delete_snapshot" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:47:59 devstack cinder-volume[83176]: DEBUG cinder.coordination [req-d7c52d2a-ce48-4895-8dcd-3151efbf8bfd req-78b49f61-8066-450f-a263-dc391f1e688d tempest-VolumesSnapshotsTestJSON-276257537 None] Lock "cinder-0d942afe-31de-45af-954f-9d313f191258-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:47:59 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-d7c52d2a-ce48-4895-8dcd-3151efbf8bfd req-78b49f61-8066-450f-a263-dc391f1e688d tempest-VolumesSnapshotsTestJSON-276257537 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:47:59 devstack cinder-volume[83176]: DEBUG cinder.coordination [req-d7c52d2a-ce48-4895-8dcd-3151efbf8bfd req-78b49f61-8066-450f-a263-dc391f1e688d tempest-VolumesSnapshotsTestJSON-276257537 None] Acquiring lock "cinder-quobyte-1df6152d-435c-44f7-a508-694b338cd402" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:47:59 devstack cinder-volume[83176]: DEBUG cinder.coordination [req-d7c52d2a-ce48-4895-8dcd-3151efbf8bfd req-78b49f61-8066-450f-a263-dc391f1e688d tempest-VolumesSnapshotsTestJSON-276257537 None] Lock "cinder-quobyte-1df6152d-435c-44f7-a508-694b338cd402" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:47:59 devstack cinder-volume[83176]: DEBUG cinder.coordination [req-d7c52d2a-ce48-4895-8dcd-3151efbf8bfd req-78b49f61-8066-450f-a263-dc391f1e688d tempest-VolumesSnapshotsTestJSON-276257537 None] Acquiring lock "cinder-quobyte-0d942afe-31de-45af-954f-9d313f191258" by "_delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:47:59 devstack cinder-volume[83176]: DEBUG cinder.coordination [req-d7c52d2a-ce48-4895-8dcd-3151efbf8bfd req-78b49f61-8066-450f-a263-dc391f1e688d tempest-VolumesSnapshotsTestJSON-276257537 None] Lock "cinder-quobyte-0d942afe-31de-45af-954f-9d313f191258" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:47:59 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [req-d7c52d2a-ce48-4895-8dcd-3151efbf8bfd req-78b49f61-8066-450f-a263-dc391f1e688d tempest-VolumesSnapshotsTestJSON-276257537 None] Deleting offline snapshot 0d942afe-31de-45af-954f-9d313f191258 of volume 1df6152d-435c-44f7-a508-694b338cd402 {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 11:47:59 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [req-d7c52d2a-ce48-4895-8dcd-3151efbf8bfd req-78b49f61-8066-450f-a263-dc391f1e688d tempest-VolumesSnapshotsTestJSON-276257537 None] snapshot_file for this snap is: volume-1df6152d-435c-44f7-a508-694b338cd402.0d942afe-31de-45af-954f-9d313f191258 {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 11:47:59 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6fa859-2893-4d72-babb-3e88dd7ac5ef]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:47:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-d7c52d2a-ce48-4895-8dcd-3151efbf8bfd req-78b49f61-8066-450f-a263-dc391f1e688d tempest-VolumesSnapshotsTestJSON-276257537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1df6152d-435c-44f7-a508-694b338cd402.0d942afe-31de-45af-954f-9d313f191258 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:47:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-d7c52d2a-ce48-4895-8dcd-3151efbf8bfd req-78b49f61-8066-450f-a263-dc391f1e688d tempest-VolumesSnapshotsTestJSON-276257537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1df6152d-435c-44f7-a508-694b338cd402.0d942afe-31de-45af-954f-9d313f191258" returned: 0 in 0.493s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:47:59 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [req-d7c52d2a-ce48-4895-8dcd-3151efbf8bfd req-78b49f61-8066-450f-a263-dc391f1e688d tempest-VolumesSnapshotsTestJSON-276257537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1df6152d-435c-44f7-a508-694b338cd402(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 11:47:59 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13f77e5-18fe-4dbe-b224-de4062f62d31]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:47:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-d7c52d2a-ce48-4895-8dcd-3151efbf8bfd req-78b49f61-8066-450f-a263-dc391f1e688d tempest-VolumesSnapshotsTestJSON-276257537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1df6152d-435c-44f7-a508-694b338cd402 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:48:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-d7c52d2a-ce48-4895-8dcd-3151efbf8bfd req-78b49f61-8066-450f-a263-dc391f1e688d tempest-VolumesSnapshotsTestJSON-276257537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1df6152d-435c-44f7-a508-694b338cd402" returned: 0 in 0.644s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:48:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-d7c52d2a-ce48-4895-8dcd-3151efbf8bfd req-78b49f61-8066-450f-a263-dc391f1e688d tempest-VolumesSnapshotsTestJSON-276257537 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1df6152d-435c-44f7-a508-694b338cd402.0d942afe-31de-45af-954f-9d313f191258 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:48:00 devstack quobyte-client[83193]: System call of process 93740 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:48:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-d7c52d2a-ce48-4895-8dcd-3151efbf8bfd req-78b49f61-8066-450f-a263-dc391f1e688d tempest-VolumesSnapshotsTestJSON-276257537 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1df6152d-435c-44f7-a508-694b338cd402.0d942afe-31de-45af-954f-9d313f191258" returned: 0 in 0.320s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:48:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-d7c52d2a-ce48-4895-8dcd-3151efbf8bfd req-78b49f61-8066-450f-a263-dc391f1e688d tempest-VolumesSnapshotsTestJSON-276257537 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1df6152d-435c-44f7-a508-694b338cd402.0d942afe-31de-45af-954f-9d313f191258 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:48:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-d7c52d2a-ce48-4895-8dcd-3151efbf8bfd req-78b49f61-8066-450f-a263-dc391f1e688d tempest-VolumesSnapshotsTestJSON-276257537 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1df6152d-435c-44f7-a508-694b338cd402.0d942afe-31de-45af-954f-9d313f191258" returned: 0 in 0.112s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:48:01 devstack cinder-volume[83176]: DEBUG cinder.coordination [req-d7c52d2a-ce48-4895-8dcd-3151efbf8bfd req-78b49f61-8066-450f-a263-dc391f1e688d tempest-VolumesSnapshotsTestJSON-276257537 None] Lock "cinder-quobyte-0d942afe-31de-45af-954f-9d313f191258" released by "_delete_snapshot" :: held 1.916s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:48:01 devstack cinder-volume[83176]: DEBUG cinder.coordination [req-d7c52d2a-ce48-4895-8dcd-3151efbf8bfd req-78b49f61-8066-450f-a263-dc391f1e688d tempest-VolumesSnapshotsTestJSON-276257537 None] Lock "cinder-quobyte-1df6152d-435c-44f7-a508-694b338cd402" released by "delete_snapshot" :: held 1.944s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:48:01 devstack cinder-volume[83176]: DEBUG cinder.quota [req-d7c52d2a-ce48-4895-8dcd-3151efbf8bfd req-78b49f61-8066-450f-a263-dc391f1e688d tempest-VolumesSnapshotsTestJSON-276257537 None] Created reservations ['4278e510-ff96-4117-9986-b063801cc54d', 'fd96f19d-f55b-41d4-b51f-057cf100811b', 'a729c7ec-399e-47aa-8009-6d45ea0de6a0', 'edab4451-e68a-44bb-8f65-1a081b52ed47'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:48:01 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-d7c52d2a-ce48-4895-8dcd-3151efbf8bfd req-78b49f61-8066-450f-a263-dc391f1e688d tempest-VolumesSnapshotsTestJSON-276257537 None] Delete snapshot completed successfully.
Sep 18 11:48:01 devstack cinder-volume[83176]: DEBUG cinder.coordination [req-d7c52d2a-ce48-4895-8dcd-3151efbf8bfd req-78b49f61-8066-450f-a263-dc391f1e688d tempest-VolumesSnapshotsTestJSON-276257537 None] Lock "cinder-0d942afe-31de-45af-954f-9d313f191258-delete_snapshot" released by "delete_snapshot" :: held 2.549s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:48:02 devstack cinder-volume[83176]: DEBUG cinder.coordination [req-c61adede-b96e-4ea0-96ff-161188e41ee0 req-8e08c665-3447-4ccc-bc41-ae926bc5241c tempest-VolumesSnapshotsTestJSON-276257537 None] Acquiring lock "cinder-1df6152d-435c-44f7-a508-694b338cd402-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:48:02 devstack cinder-volume[83176]: DEBUG cinder.coordination [req-c61adede-b96e-4ea0-96ff-161188e41ee0 req-8e08c665-3447-4ccc-bc41-ae926bc5241c tempest-VolumesSnapshotsTestJSON-276257537 None] Lock "cinder-1df6152d-435c-44f7-a508-694b338cd402-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:48:02 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-c61adede-b96e-4ea0-96ff-161188e41ee0 req-8e08c665-3447-4ccc-bc41-ae926bc5241c tempest-VolumesSnapshotsTestJSON-276257537 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:48:02 devstack cinder-volume[83176]: DEBUG cinder.coordination [req-c61adede-b96e-4ea0-96ff-161188e41ee0 req-8e08c665-3447-4ccc-bc41-ae926bc5241c tempest-VolumesSnapshotsTestJSON-276257537 None] Acquiring lock "cinder-quobyte-1df6152d-435c-44f7-a508-694b338cd402" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:48:02 devstack cinder-volume[83176]: DEBUG cinder.coordination [req-c61adede-b96e-4ea0-96ff-161188e41ee0 req-8e08c665-3447-4ccc-bc41-ae926bc5241c tempest-VolumesSnapshotsTestJSON-276257537 None] Lock "cinder-quobyte-1df6152d-435c-44f7-a508-694b338cd402" acquired by "delete_volume" :: waited 0.015s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:48:02 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5259a80f-6217-4c00-ad74-b4f7b197db67]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:48:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-c61adede-b96e-4ea0-96ff-161188e41ee0 req-8e08c665-3447-4ccc-bc41-ae926bc5241c tempest-VolumesSnapshotsTestJSON-276257537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1df6152d-435c-44f7-a508-694b338cd402 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:48:03 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-c61adede-b96e-4ea0-96ff-161188e41ee0 req-8e08c665-3447-4ccc-bc41-ae926bc5241c tempest-VolumesSnapshotsTestJSON-276257537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1df6152d-435c-44f7-a508-694b338cd402" returned: 0 in 0.409s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:48:03 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-c61adede-b96e-4ea0-96ff-161188e41ee0 req-8e08c665-3447-4ccc-bc41-ae926bc5241c tempest-VolumesSnapshotsTestJSON-276257537 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1df6152d-435c-44f7-a508-694b338cd402 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:48:03 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-c61adede-b96e-4ea0-96ff-161188e41ee0 req-8e08c665-3447-4ccc-bc41-ae926bc5241c tempest-VolumesSnapshotsTestJSON-276257537 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1df6152d-435c-44f7-a508-694b338cd402" returned: 0 in 0.111s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:48:03 devstack cinder-volume[83176]: DEBUG cinder.coordination [req-c61adede-b96e-4ea0-96ff-161188e41ee0 req-8e08c665-3447-4ccc-bc41-ae926bc5241c tempest-VolumesSnapshotsTestJSON-276257537 None] Lock "cinder-quobyte-1df6152d-435c-44f7-a508-694b338cd402" released by "delete_volume" :: held 0.707s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:48:03 devstack cinder-volume[83176]: DEBUG cinder.quota [req-c61adede-b96e-4ea0-96ff-161188e41ee0 req-8e08c665-3447-4ccc-bc41-ae926bc5241c tempest-VolumesSnapshotsTestJSON-276257537 None] Created reservations ['8c00b539-42ca-4fe7-886d-3f71fb81df99', '53ce3582-8f1f-4205-ba21-3ca2a30740d0', '08d904dc-49c1-4ff2-b4e7-13f509ea15d4', 'b0ec9e0c-341e-44df-9780-f7e5b0946c99'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:48:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-c61adede-b96e-4ea0-96ff-161188e41ee0 req-8e08c665-3447-4ccc-bc41-ae926bc5241c tempest-VolumesSnapshotsTestJSON-276257537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:48:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-c61adede-b96e-4ea0-96ff-161188e41ee0 req-8e08c665-3447-4ccc-bc41-ae926bc5241c tempest-VolumesSnapshotsTestJSON-276257537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:48:04 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [req-c61adede-b96e-4ea0-96ff-161188e41ee0 req-8e08c665-3447-4ccc-bc41-ae926bc5241c tempest-VolumesSnapshotsTestJSON-276257537 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:48:04 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [req-c61adede-b96e-4ea0-96ff-161188e41ee0 req-8e08c665-3447-4ccc-bc41-ae926bc5241c tempest-VolumesSnapshotsTestJSON-276257537 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:48:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-c61adede-b96e-4ea0-96ff-161188e41ee0 req-8e08c665-3447-4ccc-bc41-ae926bc5241c tempest-VolumesSnapshotsTestJSON-276257537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:48:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-c61adede-b96e-4ea0-96ff-161188e41ee0 req-8e08c665-3447-4ccc-bc41-ae926bc5241c tempest-VolumesSnapshotsTestJSON-276257537 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:48:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-c61adede-b96e-4ea0-96ff-161188e41ee0 req-8e08c665-3447-4ccc-bc41-ae926bc5241c tempest-VolumesSnapshotsTestJSON-276257537 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.139s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:48:04 devstack cinder-volume[83176]: DEBUG cinder.manager [req-c61adede-b96e-4ea0-96ff-161188e41ee0 req-8e08c665-3447-4ccc-bc41-ae926bc5241c tempest-VolumesSnapshotsTestJSON-276257537 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:48:04 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-c61adede-b96e-4ea0-96ff-161188e41ee0 req-8e08c665-3447-4ccc-bc41-ae926bc5241c tempest-VolumesSnapshotsTestJSON-276257537 None] Deleted volume successfully.
Sep 18 11:48:04 devstack cinder-volume[83176]: DEBUG cinder.coordination [req-c61adede-b96e-4ea0-96ff-161188e41ee0 req-8e08c665-3447-4ccc-bc41-ae926bc5241c tempest-VolumesSnapshotsTestJSON-276257537 None] Lock "cinder-1df6152d-435c-44f7-a508-694b338cd402-delete_volume" released by "delete_volume" :: held 1.886s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:48:09 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-c0f5dbae-0c95-4c58-af7d-6afaa5e7479f req-45b05892-2933-4eeb-819b-8c7df70581ad tempest-AttachVolumeShelveTestJSON-1847875693 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:48:09 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-c0f5dbae-0c95-4c58-af7d-6afaa5e7479f req-45b05892-2933-4eeb-819b-8c7df70581ad tempest-AttachVolumeShelveTestJSON-1847875693 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:48:09 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-c0f5dbae-0c95-4c58-af7d-6afaa5e7479f req-45b05892-2933-4eeb-819b-8c7df70581ad tempest-AttachVolumeShelveTestJSON-1847875693 None] No connector for attachment 08c2c9cb-7a95-4a23-b444-d71c8254d53b; skipping storage backend terminate_connection call. {{(pid=83176) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4977}}
Sep 18 11:48:09 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-c0f5dbae-0c95-4c58-af7d-6afaa5e7479f req-45b05892-2933-4eeb-819b-8c7df70581ad tempest-AttachVolumeShelveTestJSON-1847875693 None] Deleting attachment 08c2c9cb-7a95-4a23-b444-d71c8254d53b. {{(pid=83176) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 11:48:13 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 11:48:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:48:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:48:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:48:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:48:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:48:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:48:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.107s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:48:13 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:48:14 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-e2c361f9-fdae-4cee-9d73-b9e3fa77202e tempest-GroupSnapshotsTest-1932342766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:48:14 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-e2c361f9-fdae-4cee-9d73-b9e3fa77202e tempest-GroupSnapshotsTest-1932342766 None] Group tempest-GroupSnapshotsTest-Group-483399994: creating
Sep 18 11:48:14 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-e2c361f9-fdae-4cee-9d73-b9e3fa77202e tempest-GroupSnapshotsTest-1932342766 None] Group tempest-GroupSnapshotsTest-Group-483399994: created successfully
Sep 18 11:48:14 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-e2c361f9-fdae-4cee-9d73-b9e3fa77202e tempest-GroupSnapshotsTest-1932342766 None] Create group completed successfully.
Sep 18 11:48:15 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-916ebbae-afed-495b-a2fc-ab5e4ab7c3be tempest-GroupSnapshotsTest-1932342766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:48:15 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-916ebbae-afed-495b-a2fc-ab5e4ab7c3be tempest-GroupSnapshotsTest-1932342766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:48:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-916ebbae-afed-495b-a2fc-ab5e4ab7c3be tempest-GroupSnapshotsTest-1932342766 None] Flow 'volume_create_manager' (bced63fd-84d9-4ae9-9947-472b84ea6b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:48:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-916ebbae-afed-495b-a2fc-ab5e4ab7c3be tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51aca9e3-7005-4de4-9610-f542cd9b5329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:48:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-916ebbae-afed-495b-a2fc-ab5e4ab7c3be tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51aca9e3-7005-4de4-9610-f542cd9b5329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1980393556',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1d32d273-1d46-4cea-80bb-54f910ca271f,host='devstack@QuobyteHD#QuobyteHD',id=4ddc901d-0171-4700-a113-8ea9dd1779f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d94ae722052445ebceafeb6b2a04307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:48:16Z,use_quota=True,user_id='ec81defb136b46b2aeead6ca3de965e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26eb3405-ab8f-43c9-9602-fa155f4461e7),volume_type_id=26eb3405-ab8f-43c9-9602-fa155f4461e7)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:48:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-916ebbae-afed-495b-a2fc-ab5e4ab7c3be tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02794cfb-be1a-44ed-b61e-b686a3a1d6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:48:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-916ebbae-afed-495b-a2fc-ab5e4ab7c3be tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02794cfb-be1a-44ed-b61e-b686a3a1d6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:48:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-916ebbae-afed-495b-a2fc-ab5e4ab7c3be tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79df0a6b-a65c-4e45-8d24-a765b89d1e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:48:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-916ebbae-afed-495b-a2fc-ab5e4ab7c3be tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79df0a6b-a65c-4e45-8d24-a765b89d1e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ddc901d-0171-4700-a113-8ea9dd1779f9', 'volume_name': 'volume-4ddc901d-0171-4700-a113-8ea9dd1779f9', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:48:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-916ebbae-afed-495b-a2fc-ab5e4ab7c3be tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f782c0c-a067-4f74-8ded-ed952caefe2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:48:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-916ebbae-afed-495b-a2fc-ab5e4ab7c3be tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f782c0c-a067-4f74-8ded-ed952caefe2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:48:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-916ebbae-afed-495b-a2fc-ab5e4ab7c3be tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c9cca49-2ca2-4a6a-aaa4-48504b6ed3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:48:15 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-916ebbae-afed-495b-a2fc-ab5e4ab7c3be tempest-GroupSnapshotsTest-1932342766 None] Volume 4ddc901d-0171-4700-a113-8ea9dd1779f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ddc901d-0171-4700-a113-8ea9dd1779f9', 'volume_size': 1}
Sep 18 11:48:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-916ebbae-afed-495b-a2fc-ab5e4ab7c3be tempest-GroupSnapshotsTest-1932342766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:48:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-916ebbae-afed-495b-a2fc-ab5e4ab7c3be tempest-GroupSnapshotsTest-1932342766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:48:15 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-916ebbae-afed-495b-a2fc-ab5e4ab7c3be tempest-GroupSnapshotsTest-1932342766 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=1d32d273-1d46-4cea-80bb-54f910ca271f,created_at=2025-09-18T09:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1980393556',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1d32d273-1d46-4cea-80bb-54f910ca271f,host='devstack@QuobyteHD#QuobyteHD',id=4ddc901d-0171-4700-a113-8ea9dd1779f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d94ae722052445ebceafeb6b2a04307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:48:16Z,use_quota=True,user_id='ec81defb136b46b2aeead6ca3de965e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26eb3405-ab8f-43c9-9602-fa155f4461e7),volume_type_id=26eb3405-ab8f-43c9-9602-fa155f4461e7)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:48:15 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-916ebbae-afed-495b-a2fc-ab5e4ab7c3be tempest-GroupSnapshotsTest-1932342766 None] Creating volume 4ddc901d-0171-4700-a113-8ea9dd1779f9 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:48:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-916ebbae-afed-495b-a2fc-ab5e4ab7c3be tempest-GroupSnapshotsTest-1932342766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:48:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-916ebbae-afed-495b-a2fc-ab5e4ab7c3be tempest-GroupSnapshotsTest-1932342766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:48:15 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-916ebbae-afed-495b-a2fc-ab5e4ab7c3be tempest-GroupSnapshotsTest-1932342766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:48:15 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-916ebbae-afed-495b-a2fc-ab5e4ab7c3be tempest-GroupSnapshotsTest-1932342766 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:48:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-916ebbae-afed-495b-a2fc-ab5e4ab7c3be tempest-GroupSnapshotsTest-1932342766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:48:15 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-916ebbae-afed-495b-a2fc-ab5e4ab7c3be tempest-GroupSnapshotsTest-1932342766 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:48:15 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-916ebbae-afed-495b-a2fc-ab5e4ab7c3be tempest-GroupSnapshotsTest-1932342766 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:48:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-916ebbae-afed-495b-a2fc-ab5e4ab7c3be tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:48:16 devstack quobyte-client[83193]: System call of process 93754 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:48:16 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=60, name=volume-4ddc901d-0171-4700-a113-8ea9dd1779f9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:48:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-916ebbae-afed-495b-a2fc-ab5e4ab7c3be tempest-GroupSnapshotsTest-1932342766 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9 1073741824" returned: 0 in 0.384s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:48:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-916ebbae-afed-495b-a2fc-ab5e4ab7c3be tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:48:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-916ebbae-afed-495b-a2fc-ab5e4ab7c3be tempest-GroupSnapshotsTest-1932342766 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9" returned: 0 in 0.109s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:48:16 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-916ebbae-afed-495b-a2fc-ab5e4ab7c3be tempest-GroupSnapshotsTest-1932342766 None] <== create_volume: return (574ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:48:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-916ebbae-afed-495b-a2fc-ab5e4ab7c3be tempest-GroupSnapshotsTest-1932342766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.585s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:48:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-916ebbae-afed-495b-a2fc-ab5e4ab7c3be tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c9cca49-2ca2-4a6a-aaa4-48504b6ed3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ddc901d-0171-4700-a113-8ea9dd1779f9', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:48:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-916ebbae-afed-495b-a2fc-ab5e4ab7c3be tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (450b2b92-8735-4684-a9d4-fdecc99cdf65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:48:16 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-916ebbae-afed-495b-a2fc-ab5e4ab7c3be tempest-GroupSnapshotsTest-1932342766 None] Volume volume-4ddc901d-0171-4700-a113-8ea9dd1779f9 (4ddc901d-0171-4700-a113-8ea9dd1779f9): created successfully
Sep 18 11:48:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-916ebbae-afed-495b-a2fc-ab5e4ab7c3be tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (450b2b92-8735-4684-a9d4-fdecc99cdf65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:48:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-916ebbae-afed-495b-a2fc-ab5e4ab7c3be tempest-GroupSnapshotsTest-1932342766 None] Flow 'volume_create_manager' (bced63fd-84d9-4ae9-9947-472b84ea6b53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:48:16 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-916ebbae-afed-495b-a2fc-ab5e4ab7c3be tempest-GroupSnapshotsTest-1932342766 None] Created volume successfully.
Sep 18 11:48:17 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-15a069f0-b533-4170-b464-055aa9037aec tempest-GroupSnapshotsTest-1932342766 None] GroupSnapshot 6c6509d7-bd49-40a0-a603-1b7e721d63d2: creating.
Sep 18 11:48:17 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-15a069f0-b533-4170-b464-055aa9037aec tempest-GroupSnapshotsTest-1932342766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:48:17 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-15a069f0-b533-4170-b464-055aa9037aec tempest-GroupSnapshotsTest-1932342766 None] Group snapshot 6c6509d7-bd49-40a0-a603-1b7e721d63d2: creating. {{(pid=83176) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 18 11:48:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-15a069f0-b533-4170-b464-055aa9037aec tempest-GroupSnapshotsTest-1932342766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:48:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-15a069f0-b533-4170-b464-055aa9037aec tempest-GroupSnapshotsTest-1932342766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:48:17 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-15a069f0-b533-4170-b464-055aa9037aec tempest-GroupSnapshotsTest-1932342766 None] Creating offline snapshot 04d808b1-5f6e-4493-aa2e-c8066020897a of volume 4ddc901d-0171-4700-a113-8ea9dd1779f9 {{(pid=83176) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 11:48:17 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9ae527-8465-48a5-8936-0850ecf352dc]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:48:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-15a069f0-b533-4170-b464-055aa9037aec tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:48:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-15a069f0-b533-4170-b464-055aa9037aec tempest-GroupSnapshotsTest-1932342766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9" returned: 0 in 0.555s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:48:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-15a069f0-b533-4170-b464-055aa9037aec tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9.04d808b1-5f6e-4493-aa2e-c8066020897a 1G {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:48:18 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=61, name=volume-4ddc901d-0171-4700-a113-8ea9dd1779f9.04d808b1-5f6e-4493-aa2e-c8066020897a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:48:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-15a069f0-b533-4170-b464-055aa9037aec tempest-GroupSnapshotsTest-1932342766 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9.04d808b1-5f6e-4493-aa2e-c8066020897a 1G" returned: 0 in 0.268s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:48:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-15a069f0-b533-4170-b464-055aa9037aec tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4ddc901d-0171-4700-a113-8ea9dd1779f9 -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9.04d808b1-5f6e-4493-aa2e-c8066020897a {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:48:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-15a069f0-b533-4170-b464-055aa9037aec tempest-GroupSnapshotsTest-1932342766 None] CMD "qemu-img rebase -u -b volume-4ddc901d-0171-4700-a113-8ea9dd1779f9 -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9.04d808b1-5f6e-4493-aa2e-c8066020897a" returned: 0 in 0.159s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:48:18 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-15a069f0-b533-4170-b464-055aa9037aec tempest-GroupSnapshotsTest-1932342766 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9.04d808b1-5f6e-4493-aa2e-c8066020897a is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 11:48:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-15a069f0-b533-4170-b464-055aa9037aec tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9.04d808b1-5f6e-4493-aa2e-c8066020897a {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:48:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-15a069f0-b533-4170-b464-055aa9037aec tempest-GroupSnapshotsTest-1932342766 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9.04d808b1-5f6e-4493-aa2e-c8066020897a" returned: 0 in 0.104s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:48:18 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-15a069f0-b533-4170-b464-055aa9037aec tempest-GroupSnapshotsTest-1932342766 None] Setting permissions: /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9 -> 1000:1000 {{(pid=83176) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 11:48:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-15a069f0-b533-4170-b464-055aa9037aec tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9.04d808b1-5f6e-4493-aa2e-c8066020897a {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:48:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-15a069f0-b533-4170-b464-055aa9037aec tempest-GroupSnapshotsTest-1932342766 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9.04d808b1-5f6e-4493-aa2e-c8066020897a" returned: 0 in 0.118s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:48:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-15a069f0-b533-4170-b464-055aa9037aec tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9.info {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:48:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-15a069f0-b533-4170-b464-055aa9037aec tempest-GroupSnapshotsTest-1932342766 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9.info" returned: 0 in 0.153s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:48:19 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-15a069f0-b533-4170-b464-055aa9037aec tempest-GroupSnapshotsTest-1932342766 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9.info is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 11:48:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-15a069f0-b533-4170-b464-055aa9037aec tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9.info {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:48:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-15a069f0-b533-4170-b464-055aa9037aec tempest-GroupSnapshotsTest-1932342766 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9.info" returned: 0 in 0.083s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:48:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-15a069f0-b533-4170-b464-055aa9037aec tempest-GroupSnapshotsTest-1932342766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.835s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:48:19 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-15a069f0-b533-4170-b464-055aa9037aec tempest-GroupSnapshotsTest-1932342766 None] group_snapshot 6c6509d7-bd49-40a0-a603-1b7e721d63d2: created successfully
Sep 18 11:48:22 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-6f2cd522-d403-411c-9cae-79a08d5dacae tempest-GroupSnapshotsTest-1932342766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:48:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-6f2cd522-d403-411c-9cae-79a08d5dacae tempest-GroupSnapshotsTest-1932342766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:48:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-6f2cd522-d403-411c-9cae-79a08d5dacae tempest-GroupSnapshotsTest-1932342766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:48:22 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-6f2cd522-d403-411c-9cae-79a08d5dacae tempest-GroupSnapshotsTest-1932342766 None] Acquiring lock "cinder-quobyte-04d808b1-5f6e-4493-aa2e-c8066020897a-5af7264b-56a9-46a9-b018-00bc9d242710" by "_create_volume_from_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:48:22 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-6f2cd522-d403-411c-9cae-79a08d5dacae tempest-GroupSnapshotsTest-1932342766 None] Lock "cinder-quobyte-04d808b1-5f6e-4493-aa2e-c8066020897a-5af7264b-56a9-46a9-b018-00bc9d242710" acquired by "_create_volume_from_snapshot" :: waited 0.048s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:48:22 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-6f2cd522-d403-411c-9cae-79a08d5dacae tempest-GroupSnapshotsTest-1932342766 None] Creating volume 5af7264b-56a9-46a9-b018-00bc9d242710 from snapshot 04d808b1-5f6e-4493-aa2e-c8066020897a {{(pid=83176) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 18 11:48:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-6f2cd522-d403-411c-9cae-79a08d5dacae tempest-GroupSnapshotsTest-1932342766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:48:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-6f2cd522-d403-411c-9cae-79a08d5dacae tempest-GroupSnapshotsTest-1932342766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:48:22 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-6f2cd522-d403-411c-9cae-79a08d5dacae tempest-GroupSnapshotsTest-1932342766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:48:22 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-6f2cd522-d403-411c-9cae-79a08d5dacae tempest-GroupSnapshotsTest-1932342766 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:48:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-6f2cd522-d403-411c-9cae-79a08d5dacae tempest-GroupSnapshotsTest-1932342766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:48:22 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-6f2cd522-d403-411c-9cae-79a08d5dacae tempest-GroupSnapshotsTest-1932342766 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:48:22 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-6f2cd522-d403-411c-9cae-79a08d5dacae tempest-GroupSnapshotsTest-1932342766 None] Acquiring lock "cinder-quobyte-5af7264b-56a9-46a9-b018-00bc9d242710" by "_copy_volume_from_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:48:22 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-6f2cd522-d403-411c-9cae-79a08d5dacae tempest-GroupSnapshotsTest-1932342766 None] Lock "cinder-quobyte-5af7264b-56a9-46a9-b018-00bc9d242710" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:48:22 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-6f2cd522-d403-411c-9cae-79a08d5dacae tempest-GroupSnapshotsTest-1932342766 None] snapshot: 04d808b1-5f6e-4493-aa2e-c8066020897a, volume: 5af7264b-56a9-46a9-b018-00bc9d242710,  {{(pid=83176) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 18 11:48:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-6f2cd522-d403-411c-9cae-79a08d5dacae tempest-GroupSnapshotsTest-1932342766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:48:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-6f2cd522-d403-411c-9cae-79a08d5dacae tempest-GroupSnapshotsTest-1932342766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:48:22 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-6f2cd522-d403-411c-9cae-79a08d5dacae tempest-GroupSnapshotsTest-1932342766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:48:22 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-6f2cd522-d403-411c-9cae-79a08d5dacae tempest-GroupSnapshotsTest-1932342766 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:48:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-6f2cd522-d403-411c-9cae-79a08d5dacae tempest-GroupSnapshotsTest-1932342766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:48:22 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a995470-4eaf-49ae-898a-7891cc9b6adc]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:48:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6f2cd522-d403-411c-9cae-79a08d5dacae tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9.04d808b1-5f6e-4493-aa2e-c8066020897a {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:48:22 devstack quobyte-client[83193]: System call of process 93773 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:48:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6f2cd522-d403-411c-9cae-79a08d5dacae tempest-GroupSnapshotsTest-1932342766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9.04d808b1-5f6e-4493-aa2e-c8066020897a" returned: 0 in 0.588s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:48:22 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-6f2cd522-d403-411c-9cae-79a08d5dacae tempest-GroupSnapshotsTest-1932342766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ddc901d-0171-4700-a113-8ea9dd1779f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 11:48:22 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-6f2cd522-d403-411c-9cae-79a08d5dacae tempest-GroupSnapshotsTest-1932342766 None] will copy from snapshot at /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9 {{(pid=83176) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 18 11:48:22 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-6f2cd522-d403-411c-9cae-79a08d5dacae tempest-GroupSnapshotsTest-1932342766 None] Creating direct copy from snapshot {{(pid=83176) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 18 11:48:23 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[db835151-7c26-4dfa-a053-cbd8d235b8aa]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:48:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6f2cd522-d403-411c-9cae-79a08d5dacae tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:48:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6f2cd522-d403-411c-9cae-79a08d5dacae tempest-GroupSnapshotsTest-1932342766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9" returned: 0 in 0.785s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:48:23 devstack cinder-volume[83176]: DEBUG cinder.utils [None req-6f2cd522-d403-411c-9cae-79a08d5dacae tempest-GroupSnapshotsTest-1932342766 None] Path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5af7264b-56a9-46a9-b018-00bc9d242710 not found in is_blk_device check {{(pid=83176) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 18 11:48:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6f2cd522-d403-411c-9cae-79a08d5dacae tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5af7264b-56a9-46a9-b018-00bc9d242710 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:48:24 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=63, name=volume-5af7264b-56a9-46a9-b018-00bc9d242710, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:48:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6f2cd522-d403-411c-9cae-79a08d5dacae tempest-GroupSnapshotsTest-1932342766 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5af7264b-56a9-46a9-b018-00bc9d242710" returned: 0 in 6.854s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:48:30 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f73764-1b0d-4023-9136-720f798db5f6]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:48:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6f2cd522-d403-411c-9cae-79a08d5dacae tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:48:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6f2cd522-d403-411c-9cae-79a08d5dacae tempest-GroupSnapshotsTest-1932342766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9" returned: 0 in 0.625s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:48:31 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-6f2cd522-d403-411c-9cae-79a08d5dacae tempest-GroupSnapshotsTest-1932342766 None] Image conversion details: src /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9, size 1024.00 MB, duration 6.90 sec, destination /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5af7264b-56a9-46a9-b018-00bc9d242710 {{(pid=83176) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 11:48:31 devstack cinder-volume[83176]: INFO cinder.image.image_utils [None req-6f2cd522-d403-411c-9cae-79a08d5dacae tempest-GroupSnapshotsTest-1932342766 None] Converted 1024.00 MB image at 148.41 MB/s
Sep 18 11:48:31 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-6f2cd522-d403-411c-9cae-79a08d5dacae tempest-GroupSnapshotsTest-1932342766 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5af7264b-56a9-46a9-b018-00bc9d242710 is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 11:48:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6f2cd522-d403-411c-9cae-79a08d5dacae tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5af7264b-56a9-46a9-b018-00bc9d242710 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:48:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6f2cd522-d403-411c-9cae-79a08d5dacae tempest-GroupSnapshotsTest-1932342766 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5af7264b-56a9-46a9-b018-00bc9d242710" returned: 0 in 0.115s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:48:31 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-6f2cd522-d403-411c-9cae-79a08d5dacae tempest-GroupSnapshotsTest-1932342766 None] Lock "cinder-quobyte-5af7264b-56a9-46a9-b018-00bc9d242710" released by "_copy_volume_from_snapshot" :: held 9.532s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:48:31 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-6f2cd522-d403-411c-9cae-79a08d5dacae tempest-GroupSnapshotsTest-1932342766 None] Lock "cinder-quobyte-04d808b1-5f6e-4493-aa2e-c8066020897a-5af7264b-56a9-46a9-b018-00bc9d242710" released by "_create_volume_from_snapshot" :: held 9.564s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:48:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-6f2cd522-d403-411c-9cae-79a08d5dacae tempest-GroupSnapshotsTest-1932342766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.626s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:48:31 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=36,cinder:INSERT=9,cinder:UPDATE=47,cinder:DELETE=2 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:48:31 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:UPDATE=49,cinder:SELECT=42,cinder:INSERT=11,cinder:DELETE=6 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:48:32 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-6f2cd522-d403-411c-9cae-79a08d5dacae tempest-GroupSnapshotsTest-1932342766 None] Create group from source-snapshot-6c6509d7-bd49-40a0-a603-1b7e721d63d2 completed successfully.
Sep 18 11:48:33 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-71efc6e9-d669-4503-825a-1e3720ec1aee tempest-GroupSnapshotsTest-1932342766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:48:33 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-71efc6e9-d669-4503-825a-1e3720ec1aee tempest-GroupSnapshotsTest-1932342766 None] Acquiring lock "cinder-quobyte-5af7264b-56a9-46a9-b018-00bc9d242710" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:48:33 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-71efc6e9-d669-4503-825a-1e3720ec1aee tempest-GroupSnapshotsTest-1932342766 None] Lock "cinder-quobyte-5af7264b-56a9-46a9-b018-00bc9d242710" acquired by "delete_volume" :: waited 0.025s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:48:33 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdf4ba2-92bc-4ebd-aa75-32c289eae4bb]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:48:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-71efc6e9-d669-4503-825a-1e3720ec1aee tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5af7264b-56a9-46a9-b018-00bc9d242710 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:48:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-71efc6e9-d669-4503-825a-1e3720ec1aee tempest-GroupSnapshotsTest-1932342766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5af7264b-56a9-46a9-b018-00bc9d242710" returned: 0 in 0.519s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:48:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-71efc6e9-d669-4503-825a-1e3720ec1aee tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5af7264b-56a9-46a9-b018-00bc9d242710 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:48:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-71efc6e9-d669-4503-825a-1e3720ec1aee tempest-GroupSnapshotsTest-1932342766 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5af7264b-56a9-46a9-b018-00bc9d242710" returned: 0 in 0.137s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:48:34 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-71efc6e9-d669-4503-825a-1e3720ec1aee tempest-GroupSnapshotsTest-1932342766 None] Lock "cinder-quobyte-5af7264b-56a9-46a9-b018-00bc9d242710" released by "delete_volume" :: held 0.872s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:48:35 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-71efc6e9-d669-4503-825a-1e3720ec1aee tempest-GroupSnapshotsTest-1932342766 None] Created reservations ['974b7975-9512-4955-a2f8-e5a9168c8882'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:48:35 devstack cinder-volume[83176]: WARNING cinder.quota [None req-71efc6e9-d669-4503-825a-1e3720ec1aee tempest-GroupSnapshotsTest-1932342766 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-227436647 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-227436647, it is now deprecated. Please use the default quota class for default quota.
Sep 18 11:48:35 devstack cinder-volume[83176]: WARNING cinder.quota [None req-71efc6e9-d669-4503-825a-1e3720ec1aee tempest-GroupSnapshotsTest-1932342766 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-227436647 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-227436647, it is now deprecated. Please use the default quota class for default quota.
Sep 18 11:48:35 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-71efc6e9-d669-4503-825a-1e3720ec1aee tempest-GroupSnapshotsTest-1932342766 None] Created reservations ['aa225486-e70f-4c24-8c7b-7bf4921ded8c', '74f13935-c99e-4d9f-83af-d47fe43ac8c3', '0aca9521-d367-4a0c-8553-23b6690577e0', '238d91f7-e225-4dd6-88d7-5da4598d67cf'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:48:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-71efc6e9-d669-4503-825a-1e3720ec1aee tempest-GroupSnapshotsTest-1932342766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:48:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-71efc6e9-d669-4503-825a-1e3720ec1aee tempest-GroupSnapshotsTest-1932342766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:48:35 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-71efc6e9-d669-4503-825a-1e3720ec1aee tempest-GroupSnapshotsTest-1932342766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:48:35 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-71efc6e9-d669-4503-825a-1e3720ec1aee tempest-GroupSnapshotsTest-1932342766 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:48:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-71efc6e9-d669-4503-825a-1e3720ec1aee tempest-GroupSnapshotsTest-1932342766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:48:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-71efc6e9-d669-4503-825a-1e3720ec1aee tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:48:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-71efc6e9-d669-4503-825a-1e3720ec1aee tempest-GroupSnapshotsTest-1932342766 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.181s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:48:35 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-71efc6e9-d669-4503-825a-1e3720ec1aee tempest-GroupSnapshotsTest-1932342766 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:48:35 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-71efc6e9-d669-4503-825a-1e3720ec1aee tempest-GroupSnapshotsTest-1932342766 None] Delete group completed successfully.
Sep 18 11:48:36 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-14956f55-4cd0-42a3-ba12-3fa73540ac45 tempest-GroupSnapshotsTest-1932342766 None] group_snapshot 6c6509d7-bd49-40a0-a603-1b7e721d63d2: deleting
Sep 18 11:48:36 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-14956f55-4cd0-42a3-ba12-3fa73540ac45 tempest-GroupSnapshotsTest-1932342766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:48:36 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-14956f55-4cd0-42a3-ba12-3fa73540ac45 tempest-GroupSnapshotsTest-1932342766 None] group_snapshot 6c6509d7-bd49-40a0-a603-1b7e721d63d2: deleting {{(pid=83176) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 18 11:48:36 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-14956f55-4cd0-42a3-ba12-3fa73540ac45 tempest-GroupSnapshotsTest-1932342766 None] Acquiring lock "cinder-quobyte-4ddc901d-0171-4700-a113-8ea9dd1779f9" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:48:36 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-14956f55-4cd0-42a3-ba12-3fa73540ac45 tempest-GroupSnapshotsTest-1932342766 None] Lock "cinder-quobyte-4ddc901d-0171-4700-a113-8ea9dd1779f9" acquired by "delete_snapshot" :: waited 0.051s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:48:36 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-14956f55-4cd0-42a3-ba12-3fa73540ac45 tempest-GroupSnapshotsTest-1932342766 None] Acquiring lock "cinder-quobyte-04d808b1-5f6e-4493-aa2e-c8066020897a" by "_delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:48:36 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-14956f55-4cd0-42a3-ba12-3fa73540ac45 tempest-GroupSnapshotsTest-1932342766 None] Lock "cinder-quobyte-04d808b1-5f6e-4493-aa2e-c8066020897a" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:48:36 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-14956f55-4cd0-42a3-ba12-3fa73540ac45 tempest-GroupSnapshotsTest-1932342766 None] Deleting offline snapshot 04d808b1-5f6e-4493-aa2e-c8066020897a of volume 4ddc901d-0171-4700-a113-8ea9dd1779f9 {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 11:48:36 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-14956f55-4cd0-42a3-ba12-3fa73540ac45 tempest-GroupSnapshotsTest-1932342766 None] snapshot_file for this snap is: volume-4ddc901d-0171-4700-a113-8ea9dd1779f9.04d808b1-5f6e-4493-aa2e-c8066020897a {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 11:48:36 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a6da12-41bb-4ca0-bc35-adeb54cded70]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:48:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-14956f55-4cd0-42a3-ba12-3fa73540ac45 tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9.04d808b1-5f6e-4493-aa2e-c8066020897a {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:48:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-14956f55-4cd0-42a3-ba12-3fa73540ac45 tempest-GroupSnapshotsTest-1932342766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9.04d808b1-5f6e-4493-aa2e-c8066020897a" returned: 0 in 0.443s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:48:37 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-14956f55-4cd0-42a3-ba12-3fa73540ac45 tempest-GroupSnapshotsTest-1932342766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ddc901d-0171-4700-a113-8ea9dd1779f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 11:48:37 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1742b9-ab03-4c25-9568-a76e52e0394d]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:48:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-14956f55-4cd0-42a3-ba12-3fa73540ac45 tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:48:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-14956f55-4cd0-42a3-ba12-3fa73540ac45 tempest-GroupSnapshotsTest-1932342766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9" returned: 0 in 0.452s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:48:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-14956f55-4cd0-42a3-ba12-3fa73540ac45 tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9.04d808b1-5f6e-4493-aa2e-c8066020897a {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:48:37 devstack quobyte-client[83193]: System call of process 93892 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:48:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-14956f55-4cd0-42a3-ba12-3fa73540ac45 tempest-GroupSnapshotsTest-1932342766 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9.04d808b1-5f6e-4493-aa2e-c8066020897a" returned: 0 in 0.253s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:48:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-14956f55-4cd0-42a3-ba12-3fa73540ac45 tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9.04d808b1-5f6e-4493-aa2e-c8066020897a {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:48:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-14956f55-4cd0-42a3-ba12-3fa73540ac45 tempest-GroupSnapshotsTest-1932342766 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9.04d808b1-5f6e-4493-aa2e-c8066020897a" returned: 0 in 0.111s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:48:38 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-14956f55-4cd0-42a3-ba12-3fa73540ac45 tempest-GroupSnapshotsTest-1932342766 None] Lock "cinder-quobyte-04d808b1-5f6e-4493-aa2e-c8066020897a" released by "_delete_snapshot" :: held 1.541s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:48:38 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-14956f55-4cd0-42a3-ba12-3fa73540ac45 tempest-GroupSnapshotsTest-1932342766 None] Lock "cinder-quobyte-4ddc901d-0171-4700-a113-8ea9dd1779f9" released by "delete_snapshot" :: held 1.567s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:48:38 devstack cinder-volume[83176]: WARNING cinder.quota [None req-14956f55-4cd0-42a3-ba12-3fa73540ac45 tempest-GroupSnapshotsTest-1932342766 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-227436647 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-227436647, it is now deprecated. Please use the default quota class for default quota.
Sep 18 11:48:38 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-14956f55-4cd0-42a3-ba12-3fa73540ac45 tempest-GroupSnapshotsTest-1932342766 None] Created reservations ['96493783-4b1b-44dd-b3f4-7d326b35a473', '9f5bd0c7-3e7b-4a6f-b823-f8ad0c8ffa3f', 'd241ca75-77f5-41a6-9e0a-5341bc647dfb', '37c858cd-583b-40a2-a219-daffdd013344'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:48:38 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-14956f55-4cd0-42a3-ba12-3fa73540ac45 tempest-GroupSnapshotsTest-1932342766 None] group_snapshot 6c6509d7-bd49-40a0-a603-1b7e721d63d2: deleted successfully
Sep 18 11:48:39 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-f85f31a3-a60d-42c9-a6e8-79a00c9ab9b7 tempest-GroupSnapshotsTest-1932342766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:48:39 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f85f31a3-a60d-42c9-a6e8-79a00c9ab9b7 tempest-GroupSnapshotsTest-1932342766 None] Acquiring lock "cinder-quobyte-4ddc901d-0171-4700-a113-8ea9dd1779f9" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:48:39 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f85f31a3-a60d-42c9-a6e8-79a00c9ab9b7 tempest-GroupSnapshotsTest-1932342766 None] Lock "cinder-quobyte-4ddc901d-0171-4700-a113-8ea9dd1779f9" acquired by "delete_volume" :: waited 0.017s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:48:39 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4261a2-5ec1-4a42-b1ee-817e40476420]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:48:39 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f85f31a3-a60d-42c9-a6e8-79a00c9ab9b7 tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:48:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f85f31a3-a60d-42c9-a6e8-79a00c9ab9b7 tempest-GroupSnapshotsTest-1932342766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9" returned: 0 in 0.522s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:48:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f85f31a3-a60d-42c9-a6e8-79a00c9ab9b7 tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:48:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f85f31a3-a60d-42c9-a6e8-79a00c9ab9b7 tempest-GroupSnapshotsTest-1932342766 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-4ddc901d-0171-4700-a113-8ea9dd1779f9" returned: 0 in 0.110s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:48:40 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f85f31a3-a60d-42c9-a6e8-79a00c9ab9b7 tempest-GroupSnapshotsTest-1932342766 None] Lock "cinder-quobyte-4ddc901d-0171-4700-a113-8ea9dd1779f9" released by "delete_volume" :: held 0.901s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:48:41 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-f85f31a3-a60d-42c9-a6e8-79a00c9ab9b7 tempest-GroupSnapshotsTest-1932342766 None] Created reservations ['d3d2b00a-32a5-4fc4-8b65-6bd18e68e9d2'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:48:41 devstack cinder-volume[83176]: WARNING cinder.db.sqlalchemy.api [None req-f85f31a3-a60d-42c9-a6e8-79a00c9ab9b7 tempest-GroupSnapshotsTest-1932342766 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-227436647']
Sep 18 11:48:41 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-f85f31a3-a60d-42c9-a6e8-79a00c9ab9b7 tempest-GroupSnapshotsTest-1932342766 None] Created reservations ['079b4162-2e50-4ce5-9053-a0823a13c3ec', '4350e91b-b0fa-4190-9eb2-dff7d7ddcf39', '1b4adf94-a5bc-428f-b23b-868a44751ac3', '69650d16-5982-43ca-b06f-e8dcfd8172fd'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:48:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f85f31a3-a60d-42c9-a6e8-79a00c9ab9b7 tempest-GroupSnapshotsTest-1932342766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:48:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f85f31a3-a60d-42c9-a6e8-79a00c9ab9b7 tempest-GroupSnapshotsTest-1932342766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:48:41 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f85f31a3-a60d-42c9-a6e8-79a00c9ab9b7 tempest-GroupSnapshotsTest-1932342766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:48:41 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f85f31a3-a60d-42c9-a6e8-79a00c9ab9b7 tempest-GroupSnapshotsTest-1932342766 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:48:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f85f31a3-a60d-42c9-a6e8-79a00c9ab9b7 tempest-GroupSnapshotsTest-1932342766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:48:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f85f31a3-a60d-42c9-a6e8-79a00c9ab9b7 tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:48:42 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f85f31a3-a60d-42c9-a6e8-79a00c9ab9b7 tempest-GroupSnapshotsTest-1932342766 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.431s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:48:42 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-f85f31a3-a60d-42c9-a6e8-79a00c9ab9b7 tempest-GroupSnapshotsTest-1932342766 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:48:42 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-f85f31a3-a60d-42c9-a6e8-79a00c9ab9b7 tempest-GroupSnapshotsTest-1932342766 None] Delete group completed successfully.
Sep 18 11:48:44 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-7d0b3e63-0d5b-4ff8-acb4-913cc3e88801 tempest-GroupSnapshotsTest-1932342766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:48:44 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-7d0b3e63-0d5b-4ff8-acb4-913cc3e88801 tempest-GroupSnapshotsTest-1932342766 None] Group tempest-GroupSnapshotsTest-Group-1680898434: creating
Sep 18 11:48:45 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-7d0b3e63-0d5b-4ff8-acb4-913cc3e88801 tempest-GroupSnapshotsTest-1932342766 None] Group tempest-GroupSnapshotsTest-Group-1680898434: created successfully
Sep 18 11:48:45 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-7d0b3e63-0d5b-4ff8-acb4-913cc3e88801 tempest-GroupSnapshotsTest-1932342766 None] Create group completed successfully.
Sep 18 11:48:46 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-81f2038c-ebd8-4011-b64e-f7ab99ce3423 tempest-GroupSnapshotsTest-1932342766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:48:46 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-81f2038c-ebd8-4011-b64e-f7ab99ce3423 tempest-GroupSnapshotsTest-1932342766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:48:46 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-81f2038c-ebd8-4011-b64e-f7ab99ce3423 tempest-GroupSnapshotsTest-1932342766 None] Flow 'volume_create_manager' (8042d2b1-be42-462f-9abf-080102201843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:48:46 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-81f2038c-ebd8-4011-b64e-f7ab99ce3423 tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d670b74b-c8de-41bd-b9b9-7b40f54ffbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:48:46 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-81f2038c-ebd8-4011-b64e-f7ab99ce3423 tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d670b74b-c8de-41bd-b9b9-7b40f54ffbb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1221134711',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=55562154-2cf1-4e1b-9a04-84892e6718a8,host='devstack@QuobyteHD#QuobyteHD',id=c8119464-b3c0-4476-a590-a750b262cb48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d94ae722052445ebceafeb6b2a04307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:48:46Z,use_quota=True,user_id='ec81defb136b46b2aeead6ca3de965e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2a1bf09-f5a3-412d-8e36-4b96d3f76d51),volume_type_id=a2a1bf09-f5a3-412d-8e36-4b96d3f76d51)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:48:46 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-81f2038c-ebd8-4011-b64e-f7ab99ce3423 tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e7bbea1-6243-4b3b-8613-84396fc3ecae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:48:46 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-81f2038c-ebd8-4011-b64e-f7ab99ce3423 tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e7bbea1-6243-4b3b-8613-84396fc3ecae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:48:46 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-81f2038c-ebd8-4011-b64e-f7ab99ce3423 tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84726319-9595-4b06-866a-c10b4133acd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:48:46 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-81f2038c-ebd8-4011-b64e-f7ab99ce3423 tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84726319-9595-4b06-866a-c10b4133acd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8119464-b3c0-4476-a590-a750b262cb48', 'volume_name': 'volume-c8119464-b3c0-4476-a590-a750b262cb48', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:48:46 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-81f2038c-ebd8-4011-b64e-f7ab99ce3423 tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9a6946c-1c16-4fa1-88ec-fa95638e94a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:48:46 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-81f2038c-ebd8-4011-b64e-f7ab99ce3423 tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9a6946c-1c16-4fa1-88ec-fa95638e94a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:48:46 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-81f2038c-ebd8-4011-b64e-f7ab99ce3423 tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3be6ab62-b9d6-439d-87a6-caad21479b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:48:46 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-81f2038c-ebd8-4011-b64e-f7ab99ce3423 tempest-GroupSnapshotsTest-1932342766 None] Volume c8119464-b3c0-4476-a590-a750b262cb48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8119464-b3c0-4476-a590-a750b262cb48', 'volume_size': 1}
Sep 18 11:48:46 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-81f2038c-ebd8-4011-b64e-f7ab99ce3423 tempest-GroupSnapshotsTest-1932342766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:48:46 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-81f2038c-ebd8-4011-b64e-f7ab99ce3423 tempest-GroupSnapshotsTest-1932342766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:48:46 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-81f2038c-ebd8-4011-b64e-f7ab99ce3423 tempest-GroupSnapshotsTest-1932342766 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=55562154-2cf1-4e1b-9a04-84892e6718a8,created_at=2025-09-18T09:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1221134711',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=55562154-2cf1-4e1b-9a04-84892e6718a8,host='devstack@QuobyteHD#QuobyteHD',id=c8119464-b3c0-4476-a590-a750b262cb48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d94ae722052445ebceafeb6b2a04307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:48:46Z,use_quota=True,user_id='ec81defb136b46b2aeead6ca3de965e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2a1bf09-f5a3-412d-8e36-4b96d3f76d51),volume_type_id=a2a1bf09-f5a3-412d-8e36-4b96d3f76d51)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:48:46 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-81f2038c-ebd8-4011-b64e-f7ab99ce3423 tempest-GroupSnapshotsTest-1932342766 None] Creating volume c8119464-b3c0-4476-a590-a750b262cb48 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:48:46 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-81f2038c-ebd8-4011-b64e-f7ab99ce3423 tempest-GroupSnapshotsTest-1932342766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:48:46 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-81f2038c-ebd8-4011-b64e-f7ab99ce3423 tempest-GroupSnapshotsTest-1932342766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:48:46 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-81f2038c-ebd8-4011-b64e-f7ab99ce3423 tempest-GroupSnapshotsTest-1932342766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:48:46 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-81f2038c-ebd8-4011-b64e-f7ab99ce3423 tempest-GroupSnapshotsTest-1932342766 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:48:46 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-81f2038c-ebd8-4011-b64e-f7ab99ce3423 tempest-GroupSnapshotsTest-1932342766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:48:46 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-81f2038c-ebd8-4011-b64e-f7ab99ce3423 tempest-GroupSnapshotsTest-1932342766 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:48:46 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-81f2038c-ebd8-4011-b64e-f7ab99ce3423 tempest-GroupSnapshotsTest-1932342766 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:48:46 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-81f2038c-ebd8-4011-b64e-f7ab99ce3423 tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c8119464-b3c0-4476-a590-a750b262cb48 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:48:46 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=64, name=volume-c8119464-b3c0-4476-a590-a750b262cb48, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:48:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-81f2038c-ebd8-4011-b64e-f7ab99ce3423 tempest-GroupSnapshotsTest-1932342766 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c8119464-b3c0-4476-a590-a750b262cb48 1073741824" returned: 0 in 0.580s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:48:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-81f2038c-ebd8-4011-b64e-f7ab99ce3423 tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c8119464-b3c0-4476-a590-a750b262cb48 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:48:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-81f2038c-ebd8-4011-b64e-f7ab99ce3423 tempest-GroupSnapshotsTest-1932342766 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c8119464-b3c0-4476-a590-a750b262cb48" returned: 0 in 0.108s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:48:47 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-81f2038c-ebd8-4011-b64e-f7ab99ce3423 tempest-GroupSnapshotsTest-1932342766 None] <== create_volume: return (757ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:48:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-81f2038c-ebd8-4011-b64e-f7ab99ce3423 tempest-GroupSnapshotsTest-1932342766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:48:47 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-81f2038c-ebd8-4011-b64e-f7ab99ce3423 tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3be6ab62-b9d6-439d-87a6-caad21479b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8119464-b3c0-4476-a590-a750b262cb48', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:48:47 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-81f2038c-ebd8-4011-b64e-f7ab99ce3423 tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88f55c09-f18a-4bf8-b742-b677c604c123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:48:47 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-81f2038c-ebd8-4011-b64e-f7ab99ce3423 tempest-GroupSnapshotsTest-1932342766 None] Volume volume-c8119464-b3c0-4476-a590-a750b262cb48 (c8119464-b3c0-4476-a590-a750b262cb48): created successfully
Sep 18 11:48:47 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-81f2038c-ebd8-4011-b64e-f7ab99ce3423 tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88f55c09-f18a-4bf8-b742-b677c604c123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:48:47 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-81f2038c-ebd8-4011-b64e-f7ab99ce3423 tempest-GroupSnapshotsTest-1932342766 None] Flow 'volume_create_manager' (8042d2b1-be42-462f-9abf-080102201843) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:48:47 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-81f2038c-ebd8-4011-b64e-f7ab99ce3423 tempest-GroupSnapshotsTest-1932342766 None] Created volume successfully.
Sep 18 11:48:49 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-3ccbefcd-728e-4d0f-b597-d256fc85e931 tempest-GroupSnapshotsTest-1932342766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:48:49 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ccbefcd-728e-4d0f-b597-d256fc85e931 tempest-GroupSnapshotsTest-1932342766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:48:49 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3ccbefcd-728e-4d0f-b597-d256fc85e931 tempest-GroupSnapshotsTest-1932342766 None] Flow 'volume_create_manager' (0126ddf8-1759-4e44-88fb-0121814631c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:48:49 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3ccbefcd-728e-4d0f-b597-d256fc85e931 tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59618820-270b-4cef-9761-b84f57e11dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:48:49 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3ccbefcd-728e-4d0f-b597-d256fc85e931 tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59618820-270b-4cef-9761-b84f57e11dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:48:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1707551714',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=55562154-2cf1-4e1b-9a04-84892e6718a8,host='devstack@QuobyteHD#QuobyteHD',id=dc4a240a-1ff4-465e-b4cd-ca586f2c58c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d94ae722052445ebceafeb6b2a04307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:48:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:48:49Z,use_quota=True,user_id='ec81defb136b46b2aeead6ca3de965e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2a1bf09-f5a3-412d-8e36-4b96d3f76d51),volume_type_id=a2a1bf09-f5a3-412d-8e36-4b96d3f76d51)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:48:49 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3ccbefcd-728e-4d0f-b597-d256fc85e931 tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c4e018c-9a18-450a-a1e0-0ae1127f6d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:48:49 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3ccbefcd-728e-4d0f-b597-d256fc85e931 tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c4e018c-9a18-450a-a1e0-0ae1127f6d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:48:49 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3ccbefcd-728e-4d0f-b597-d256fc85e931 tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf2c4528-86ed-4604-af6a-409d5b9f3a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:48:49 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3ccbefcd-728e-4d0f-b597-d256fc85e931 tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf2c4528-86ed-4604-af6a-409d5b9f3a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc4a240a-1ff4-465e-b4cd-ca586f2c58c0', 'volume_name': 'volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:48:49 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3ccbefcd-728e-4d0f-b597-d256fc85e931 tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (471b31a5-e52f-49ae-8bc7-bc76ab9ac874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:48:49 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3ccbefcd-728e-4d0f-b597-d256fc85e931 tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (471b31a5-e52f-49ae-8bc7-bc76ab9ac874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:48:49 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3ccbefcd-728e-4d0f-b597-d256fc85e931 tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2306c8a4-4660-4eeb-862e-bcce3dc7f804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:48:49 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-3ccbefcd-728e-4d0f-b597-d256fc85e931 tempest-GroupSnapshotsTest-1932342766 None] Volume dc4a240a-1ff4-465e-b4cd-ca586f2c58c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0', 'volume_size': 1}
Sep 18 11:48:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-3ccbefcd-728e-4d0f-b597-d256fc85e931 tempest-GroupSnapshotsTest-1932342766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:48:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-3ccbefcd-728e-4d0f-b597-d256fc85e931 tempest-GroupSnapshotsTest-1932342766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:48:49 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-3ccbefcd-728e-4d0f-b597-d256fc85e931 tempest-GroupSnapshotsTest-1932342766 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=55562154-2cf1-4e1b-9a04-84892e6718a8,created_at=2025-09-18T09:48:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1707551714',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=55562154-2cf1-4e1b-9a04-84892e6718a8,host='devstack@QuobyteHD#QuobyteHD',id=dc4a240a-1ff4-465e-b4cd-ca586f2c58c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d94ae722052445ebceafeb6b2a04307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:48:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:48:49Z,use_quota=True,user_id='ec81defb136b46b2aeead6ca3de965e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2a1bf09-f5a3-412d-8e36-4b96d3f76d51),volume_type_id=a2a1bf09-f5a3-412d-8e36-4b96d3f76d51)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:48:49 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-3ccbefcd-728e-4d0f-b597-d256fc85e931 tempest-GroupSnapshotsTest-1932342766 None] Creating volume dc4a240a-1ff4-465e-b4cd-ca586f2c58c0 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:48:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-3ccbefcd-728e-4d0f-b597-d256fc85e931 tempest-GroupSnapshotsTest-1932342766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:48:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-3ccbefcd-728e-4d0f-b597-d256fc85e931 tempest-GroupSnapshotsTest-1932342766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:48:49 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-3ccbefcd-728e-4d0f-b597-d256fc85e931 tempest-GroupSnapshotsTest-1932342766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:48:49 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-3ccbefcd-728e-4d0f-b597-d256fc85e931 tempest-GroupSnapshotsTest-1932342766 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:48:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-3ccbefcd-728e-4d0f-b597-d256fc85e931 tempest-GroupSnapshotsTest-1932342766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:48:49 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-3ccbefcd-728e-4d0f-b597-d256fc85e931 tempest-GroupSnapshotsTest-1932342766 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:48:49 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-3ccbefcd-728e-4d0f-b597-d256fc85e931 tempest-GroupSnapshotsTest-1932342766 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:48:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-3ccbefcd-728e-4d0f-b597-d256fc85e931 tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:48:50 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=65, name=volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:48:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-3ccbefcd-728e-4d0f-b597-d256fc85e931 tempest-GroupSnapshotsTest-1932342766 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0 1073741824" returned: 0 in 0.610s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:48:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-3ccbefcd-728e-4d0f-b597-d256fc85e931 tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:48:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-3ccbefcd-728e-4d0f-b597-d256fc85e931 tempest-GroupSnapshotsTest-1932342766 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0" returned: 0 in 0.166s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:48:50 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-3ccbefcd-728e-4d0f-b597-d256fc85e931 tempest-GroupSnapshotsTest-1932342766 None] <== create_volume: return (895ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:48:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-3ccbefcd-728e-4d0f-b597-d256fc85e931 tempest-GroupSnapshotsTest-1932342766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:48:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3ccbefcd-728e-4d0f-b597-d256fc85e931 tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2306c8a4-4660-4eeb-862e-bcce3dc7f804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:48:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3ccbefcd-728e-4d0f-b597-d256fc85e931 tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (494902ee-95df-4259-a37e-cf0131307de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:48:50 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-3ccbefcd-728e-4d0f-b597-d256fc85e931 tempest-GroupSnapshotsTest-1932342766 None] Volume volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0 (dc4a240a-1ff4-465e-b4cd-ca586f2c58c0): created successfully
Sep 18 11:48:51 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3ccbefcd-728e-4d0f-b597-d256fc85e931 tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (494902ee-95df-4259-a37e-cf0131307de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:48:51 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-3ccbefcd-728e-4d0f-b597-d256fc85e931 tempest-GroupSnapshotsTest-1932342766 None] Flow 'volume_create_manager' (0126ddf8-1759-4e44-88fb-0121814631c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:48:51 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-3ccbefcd-728e-4d0f-b597-d256fc85e931 tempest-GroupSnapshotsTest-1932342766 None] Created volume successfully.
Sep 18 11:48:51 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-d7492277-0104-4608-a07d-79359d651a0e tempest-GroupSnapshotsTest-1932342766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:48:51 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-d7492277-0104-4608-a07d-79359d651a0e tempest-GroupSnapshotsTest-1932342766 None] Update group completed successfully.
Sep 18 11:48:52 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-fe972217-a2c1-4e65-aff2-b06d9eb423a1 tempest-GroupSnapshotsTest-1932342766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:48:52 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-fe972217-a2c1-4e65-aff2-b06d9eb423a1 tempest-GroupSnapshotsTest-1932342766 None] Update group completed successfully.
Sep 18 11:48:54 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-c9ede3d1-8b52-431e-a6f3-4a9814ee1967 tempest-GroupSnapshotsTest-1932342766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:48:54 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-c9ede3d1-8b52-431e-a6f3-4a9814ee1967 tempest-GroupSnapshotsTest-1932342766 None] Update group completed successfully.
Sep 18 11:48:55 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-0bb248ba-65d3-4d54-babe-1fa9c8ee5896 tempest-GroupSnapshotsTest-1932342766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:48:55 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-0bb248ba-65d3-4d54-babe-1fa9c8ee5896 tempest-GroupSnapshotsTest-1932342766 None] Update group completed successfully.
Sep 18 11:48:57 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] GroupSnapshot 972858ae-b8e0-412d-a39a-8a1c0db6eeca: creating.
Sep 18 11:48:57 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:48:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] Group snapshot 972858ae-b8e0-412d-a39a-8a1c0db6eeca: creating. {{(pid=83176) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 18 11:48:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:48:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:48:57 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] Creating offline snapshot 1d5b4d50-3b40-4581-9694-331409cbccfb of volume c8119464-b3c0-4476-a590-a750b262cb48 {{(pid=83176) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 11:48:57 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f54033-70a5-41f6-a9e9-06b00436bff3]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:48:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c8119464-b3c0-4476-a590-a750b262cb48 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:48:57 devstack quobyte-client[83193]: System call of process 93999 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:48:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c8119464-b3c0-4476-a590-a750b262cb48" returned: 0 in 0.461s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:48:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c8119464-b3c0-4476-a590-a750b262cb48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c8119464-b3c0-4476-a590-a750b262cb48.1d5b4d50-3b40-4581-9694-331409cbccfb 1G {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:48:57 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=66, name=volume-c8119464-b3c0-4476-a590-a750b262cb48.1d5b4d50-3b40-4581-9694-331409cbccfb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:48:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c8119464-b3c0-4476-a590-a750b262cb48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c8119464-b3c0-4476-a590-a750b262cb48.1d5b4d50-3b40-4581-9694-331409cbccfb 1G" returned: 0 in 0.253s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:48:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c8119464-b3c0-4476-a590-a750b262cb48 -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c8119464-b3c0-4476-a590-a750b262cb48.1d5b4d50-3b40-4581-9694-331409cbccfb {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:48:58 devstack quobyte-client[83193]: System call of process 94005 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:48:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] CMD "qemu-img rebase -u -b volume-c8119464-b3c0-4476-a590-a750b262cb48 -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c8119464-b3c0-4476-a590-a750b262cb48.1d5b4d50-3b40-4581-9694-331409cbccfb" returned: 0 in 0.202s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:48:58 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c8119464-b3c0-4476-a590-a750b262cb48.1d5b4d50-3b40-4581-9694-331409cbccfb is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 11:48:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c8119464-b3c0-4476-a590-a750b262cb48.1d5b4d50-3b40-4581-9694-331409cbccfb {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:48:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c8119464-b3c0-4476-a590-a750b262cb48.1d5b4d50-3b40-4581-9694-331409cbccfb" returned: 0 in 0.168s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:48:58 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] Setting permissions: /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c8119464-b3c0-4476-a590-a750b262cb48 -> 1000:1000 {{(pid=83176) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 11:48:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c8119464-b3c0-4476-a590-a750b262cb48 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c8119464-b3c0-4476-a590-a750b262cb48.1d5b4d50-3b40-4581-9694-331409cbccfb {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:48:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c8119464-b3c0-4476-a590-a750b262cb48 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c8119464-b3c0-4476-a590-a750b262cb48.1d5b4d50-3b40-4581-9694-331409cbccfb" returned: 0 in 0.162s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:48:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c8119464-b3c0-4476-a590-a750b262cb48.info {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:48:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c8119464-b3c0-4476-a590-a750b262cb48.info" returned: 0 in 0.166s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:48:58 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c8119464-b3c0-4476-a590-a750b262cb48.info is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 11:48:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c8119464-b3c0-4476-a590-a750b262cb48.info {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:48:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c8119464-b3c0-4476-a590-a750b262cb48.info" returned: 0 in 0.132s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:48:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.904s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:48:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:48:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:48:59 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] Creating offline snapshot f3a51aab-1023-4de5-9206-aa7cea425cdb of volume dc4a240a-1ff4-465e-b4cd-ca586f2c58c0 {{(pid=83176) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 11:48:59 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28f6605-5f73-41b9-b2db-f4d292068229]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:48:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:48:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0" returned: 0 in 0.518s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:48:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0.f3a51aab-1023-4de5-9206-aa7cea425cdb 1G {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:00 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=68, name=volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0.f3a51aab-1023-4de5-9206-aa7cea425cdb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:49:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0.f3a51aab-1023-4de5-9206-aa7cea425cdb 1G" returned: 0 in 0.269s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): qemu-img rebase -u -b volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0 -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0.f3a51aab-1023-4de5-9206-aa7cea425cdb {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:00 devstack quobyte-client[83193]: System call of process 94019 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:49:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] CMD "qemu-img rebase -u -b volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0 -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0.f3a51aab-1023-4de5-9206-aa7cea425cdb" returned: 0 in 0.276s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:00 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0.f3a51aab-1023-4de5-9206-aa7cea425cdb is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 11:49:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0.f3a51aab-1023-4de5-9206-aa7cea425cdb {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0.f3a51aab-1023-4de5-9206-aa7cea425cdb" returned: 0 in 0.097s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:00 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] Setting permissions: /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0 -> 1000:1000 {{(pid=83176) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 11:49:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0.f3a51aab-1023-4de5-9206-aa7cea425cdb {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0.f3a51aab-1023-4de5-9206-aa7cea425cdb" returned: 0 in 0.092s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0.info {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0.info" returned: 0 in 0.104s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:00 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0.info is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 11:49:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0.info {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0.info" returned: 0 in 0.092s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.026s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:49:01 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-a865b883-93ad-454e-a0d9-e44fa751e202 tempest-GroupSnapshotsTest-1932342766 None] group_snapshot 972858ae-b8e0-412d-a39a-8a1c0db6eeca: created successfully
Sep 18 11:49:02 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-d3fd9cd9-72fa-4bac-8ac6-2cb0a037c15c tempest-GroupSnapshotsTest-1932342766 None] group_snapshot 972858ae-b8e0-412d-a39a-8a1c0db6eeca: deleting
Sep 18 11:49:02 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-d3fd9cd9-72fa-4bac-8ac6-2cb0a037c15c tempest-GroupSnapshotsTest-1932342766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:49:02 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d3fd9cd9-72fa-4bac-8ac6-2cb0a037c15c tempest-GroupSnapshotsTest-1932342766 None] group_snapshot 972858ae-b8e0-412d-a39a-8a1c0db6eeca: deleting {{(pid=83176) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 18 11:49:02 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-d3fd9cd9-72fa-4bac-8ac6-2cb0a037c15c tempest-GroupSnapshotsTest-1932342766 None] Acquiring lock "cinder-quobyte-c8119464-b3c0-4476-a590-a750b262cb48" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:49:02 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-d3fd9cd9-72fa-4bac-8ac6-2cb0a037c15c tempest-GroupSnapshotsTest-1932342766 None] Lock "cinder-quobyte-c8119464-b3c0-4476-a590-a750b262cb48" acquired by "delete_snapshot" :: waited 0.052s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:49:02 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-d3fd9cd9-72fa-4bac-8ac6-2cb0a037c15c tempest-GroupSnapshotsTest-1932342766 None] Acquiring lock "cinder-quobyte-1d5b4d50-3b40-4581-9694-331409cbccfb" by "_delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:49:02 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-d3fd9cd9-72fa-4bac-8ac6-2cb0a037c15c tempest-GroupSnapshotsTest-1932342766 None] Lock "cinder-quobyte-1d5b4d50-3b40-4581-9694-331409cbccfb" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:49:02 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-d3fd9cd9-72fa-4bac-8ac6-2cb0a037c15c tempest-GroupSnapshotsTest-1932342766 None] Deleting offline snapshot 1d5b4d50-3b40-4581-9694-331409cbccfb of volume c8119464-b3c0-4476-a590-a750b262cb48 {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 11:49:02 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-d3fd9cd9-72fa-4bac-8ac6-2cb0a037c15c tempest-GroupSnapshotsTest-1932342766 None] snapshot_file for this snap is: volume-c8119464-b3c0-4476-a590-a750b262cb48.1d5b4d50-3b40-4581-9694-331409cbccfb {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 11:49:02 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a386434a-6e47-4d87-ae70-6e94373ef548]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:49:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d3fd9cd9-72fa-4bac-8ac6-2cb0a037c15c tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c8119464-b3c0-4476-a590-a750b262cb48.1d5b4d50-3b40-4581-9694-331409cbccfb {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:03 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d3fd9cd9-72fa-4bac-8ac6-2cb0a037c15c tempest-GroupSnapshotsTest-1932342766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c8119464-b3c0-4476-a590-a750b262cb48.1d5b4d50-3b40-4581-9694-331409cbccfb" returned: 0 in 0.497s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:03 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-d3fd9cd9-72fa-4bac-8ac6-2cb0a037c15c tempest-GroupSnapshotsTest-1932342766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8119464-b3c0-4476-a590-a750b262cb48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 11:49:03 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e3d671-b301-414b-a330-e84a7203b5a1]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:49:03 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d3fd9cd9-72fa-4bac-8ac6-2cb0a037c15c tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c8119464-b3c0-4476-a590-a750b262cb48 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:03 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d3fd9cd9-72fa-4bac-8ac6-2cb0a037c15c tempest-GroupSnapshotsTest-1932342766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c8119464-b3c0-4476-a590-a750b262cb48" returned: 0 in 0.472s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:03 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d3fd9cd9-72fa-4bac-8ac6-2cb0a037c15c tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c8119464-b3c0-4476-a590-a750b262cb48.1d5b4d50-3b40-4581-9694-331409cbccfb {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:04 devstack quobyte-client[83193]: System call of process 94037 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:49:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d3fd9cd9-72fa-4bac-8ac6-2cb0a037c15c tempest-GroupSnapshotsTest-1932342766 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c8119464-b3c0-4476-a590-a750b262cb48.1d5b4d50-3b40-4581-9694-331409cbccfb" returned: 0 in 0.230s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d3fd9cd9-72fa-4bac-8ac6-2cb0a037c15c tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c8119464-b3c0-4476-a590-a750b262cb48.1d5b4d50-3b40-4581-9694-331409cbccfb {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d3fd9cd9-72fa-4bac-8ac6-2cb0a037c15c tempest-GroupSnapshotsTest-1932342766 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c8119464-b3c0-4476-a590-a750b262cb48.1d5b4d50-3b40-4581-9694-331409cbccfb" returned: 0 in 0.122s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:04 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-d3fd9cd9-72fa-4bac-8ac6-2cb0a037c15c tempest-GroupSnapshotsTest-1932342766 None] Lock "cinder-quobyte-1d5b4d50-3b40-4581-9694-331409cbccfb" released by "_delete_snapshot" :: held 1.680s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:49:04 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-d3fd9cd9-72fa-4bac-8ac6-2cb0a037c15c tempest-GroupSnapshotsTest-1932342766 None] Lock "cinder-quobyte-c8119464-b3c0-4476-a590-a750b262cb48" released by "delete_snapshot" :: held 1.721s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:49:04 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-d3fd9cd9-72fa-4bac-8ac6-2cb0a037c15c tempest-GroupSnapshotsTest-1932342766 None] Acquiring lock "cinder-quobyte-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:49:04 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-d3fd9cd9-72fa-4bac-8ac6-2cb0a037c15c tempest-GroupSnapshotsTest-1932342766 None] Lock "cinder-quobyte-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0" acquired by "delete_snapshot" :: waited 0.034s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:49:04 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-d3fd9cd9-72fa-4bac-8ac6-2cb0a037c15c tempest-GroupSnapshotsTest-1932342766 None] Acquiring lock "cinder-quobyte-f3a51aab-1023-4de5-9206-aa7cea425cdb" by "_delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:49:04 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-d3fd9cd9-72fa-4bac-8ac6-2cb0a037c15c tempest-GroupSnapshotsTest-1932342766 None] Lock "cinder-quobyte-f3a51aab-1023-4de5-9206-aa7cea425cdb" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:49:04 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-d3fd9cd9-72fa-4bac-8ac6-2cb0a037c15c tempest-GroupSnapshotsTest-1932342766 None] Deleting offline snapshot f3a51aab-1023-4de5-9206-aa7cea425cdb of volume dc4a240a-1ff4-465e-b4cd-ca586f2c58c0 {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 11:49:04 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-d3fd9cd9-72fa-4bac-8ac6-2cb0a037c15c tempest-GroupSnapshotsTest-1932342766 None] snapshot_file for this snap is: volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0.f3a51aab-1023-4de5-9206-aa7cea425cdb {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 11:49:04 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[056fbcc0-1b73-485a-9f9d-118aaf1c1db0]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:49:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d3fd9cd9-72fa-4bac-8ac6-2cb0a037c15c tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0.f3a51aab-1023-4de5-9206-aa7cea425cdb {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:05 devstack quobyte-client[83193]: System call of process 94043 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:49:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d3fd9cd9-72fa-4bac-8ac6-2cb0a037c15c tempest-GroupSnapshotsTest-1932342766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0.f3a51aab-1023-4de5-9206-aa7cea425cdb" returned: 0 in 0.538s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:05 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-d3fd9cd9-72fa-4bac-8ac6-2cb0a037c15c tempest-GroupSnapshotsTest-1932342766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 11:49:05 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0228821-5b15-4125-a15e-829689be170d]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:49:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d3fd9cd9-72fa-4bac-8ac6-2cb0a037c15c tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d3fd9cd9-72fa-4bac-8ac6-2cb0a037c15c tempest-GroupSnapshotsTest-1932342766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0" returned: 0 in 0.419s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d3fd9cd9-72fa-4bac-8ac6-2cb0a037c15c tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0.f3a51aab-1023-4de5-9206-aa7cea425cdb {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:06 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d3fd9cd9-72fa-4bac-8ac6-2cb0a037c15c tempest-GroupSnapshotsTest-1932342766 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0.f3a51aab-1023-4de5-9206-aa7cea425cdb" returned: 0 in 0.256s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:06 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d3fd9cd9-72fa-4bac-8ac6-2cb0a037c15c tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0.f3a51aab-1023-4de5-9206-aa7cea425cdb {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:06 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d3fd9cd9-72fa-4bac-8ac6-2cb0a037c15c tempest-GroupSnapshotsTest-1932342766 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0.f3a51aab-1023-4de5-9206-aa7cea425cdb" returned: 0 in 0.141s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:06 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-d3fd9cd9-72fa-4bac-8ac6-2cb0a037c15c tempest-GroupSnapshotsTest-1932342766 None] Lock "cinder-quobyte-f3a51aab-1023-4de5-9206-aa7cea425cdb" released by "_delete_snapshot" :: held 1.677s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:49:06 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-d3fd9cd9-72fa-4bac-8ac6-2cb0a037c15c tempest-GroupSnapshotsTest-1932342766 None] Lock "cinder-quobyte-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0" released by "delete_snapshot" :: held 1.715s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:49:06 devstack cinder-volume[83176]: WARNING cinder.quota [None req-d3fd9cd9-72fa-4bac-8ac6-2cb0a037c15c tempest-GroupSnapshotsTest-1932342766 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-941707012 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-941707012, it is now deprecated. Please use the default quota class for default quota.
Sep 18 11:49:06 devstack cinder-volume[83176]: WARNING cinder.quota [None req-d3fd9cd9-72fa-4bac-8ac6-2cb0a037c15c tempest-GroupSnapshotsTest-1932342766 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-941707012 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-941707012, it is now deprecated. Please use the default quota class for default quota.
Sep 18 11:49:06 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-d3fd9cd9-72fa-4bac-8ac6-2cb0a037c15c tempest-GroupSnapshotsTest-1932342766 None] Created reservations ['8ddaff77-a78d-4bf3-9292-49812cbd23f6', '12939ebb-8441-4a66-a201-e83684314b16', '78f4d0d5-3221-417b-9192-defc0a0c96aa', '8645bebf-94b6-4d72-92b5-5349c8cf236f'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:49:07 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-d3fd9cd9-72fa-4bac-8ac6-2cb0a037c15c tempest-GroupSnapshotsTest-1932342766 None] Created reservations ['d6006a9c-d9d1-4793-b3ed-d6b15b087f23', 'f90c80ac-fecc-4d86-9184-c487bb1edafe', 'fc4f1cad-9a3d-4404-b471-9a19f0417da8', '0881d9f6-f60f-4c64-8595-5344b20e945b'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:49:07 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-d3fd9cd9-72fa-4bac-8ac6-2cb0a037c15c tempest-GroupSnapshotsTest-1932342766 None] group_snapshot 972858ae-b8e0-412d-a39a-8a1c0db6eeca: deleted successfully
Sep 18 11:49:07 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-6efe8142-c962-4cf3-9fa2-e694dc8b7e55 tempest-GroupSnapshotsTest-1932342766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:49:07 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-6efe8142-c962-4cf3-9fa2-e694dc8b7e55 tempest-GroupSnapshotsTest-1932342766 None] Acquiring lock "cinder-quobyte-c8119464-b3c0-4476-a590-a750b262cb48" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:49:07 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-6efe8142-c962-4cf3-9fa2-e694dc8b7e55 tempest-GroupSnapshotsTest-1932342766 None] Lock "cinder-quobyte-c8119464-b3c0-4476-a590-a750b262cb48" acquired by "delete_volume" :: waited 0.035s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:49:07 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd685a50-2e0f-4498-9e1b-d0c3b9e0ee2b]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:49:07 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6efe8142-c962-4cf3-9fa2-e694dc8b7e55 tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c8119464-b3c0-4476-a590-a750b262cb48 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6efe8142-c962-4cf3-9fa2-e694dc8b7e55 tempest-GroupSnapshotsTest-1932342766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c8119464-b3c0-4476-a590-a750b262cb48" returned: 0 in 0.604s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6efe8142-c962-4cf3-9fa2-e694dc8b7e55 tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c8119464-b3c0-4476-a590-a750b262cb48 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6efe8142-c962-4cf3-9fa2-e694dc8b7e55 tempest-GroupSnapshotsTest-1932342766 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c8119464-b3c0-4476-a590-a750b262cb48" returned: 0 in 0.185s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:08 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-6efe8142-c962-4cf3-9fa2-e694dc8b7e55 tempest-GroupSnapshotsTest-1932342766 None] Lock "cinder-quobyte-c8119464-b3c0-4476-a590-a750b262cb48" released by "delete_volume" :: held 0.939s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:49:08 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-6efe8142-c962-4cf3-9fa2-e694dc8b7e55 tempest-GroupSnapshotsTest-1932342766 None] Acquiring lock "cinder-quobyte-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:49:08 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-6efe8142-c962-4cf3-9fa2-e694dc8b7e55 tempest-GroupSnapshotsTest-1932342766 None] Lock "cinder-quobyte-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0" acquired by "delete_volume" :: waited 0.017s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:49:08 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[84bd195e-a4f2-4d29-848d-9d601ca26e68]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:49:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6efe8142-c962-4cf3-9fa2-e694dc8b7e55 tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6efe8142-c962-4cf3-9fa2-e694dc8b7e55 tempest-GroupSnapshotsTest-1932342766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0" returned: 0 in 0.530s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6efe8142-c962-4cf3-9fa2-e694dc8b7e55 tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6efe8142-c962-4cf3-9fa2-e694dc8b7e55 tempest-GroupSnapshotsTest-1932342766 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0" returned: 0 in 0.088s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:09 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-6efe8142-c962-4cf3-9fa2-e694dc8b7e55 tempest-GroupSnapshotsTest-1932342766 None] Lock "cinder-quobyte-dc4a240a-1ff4-465e-b4cd-ca586f2c58c0" released by "delete_volume" :: held 0.793s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:49:09 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-6efe8142-c962-4cf3-9fa2-e694dc8b7e55 tempest-GroupSnapshotsTest-1932342766 None] Created reservations ['b4bdf972-44d8-4407-b818-9986ba5240b9'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:49:09 devstack cinder-volume[83176]: WARNING cinder.quota [None req-6efe8142-c962-4cf3-9fa2-e694dc8b7e55 tempest-GroupSnapshotsTest-1932342766 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-941707012 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-941707012, it is now deprecated. Please use the default quota class for default quota.
Sep 18 11:49:09 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-6efe8142-c962-4cf3-9fa2-e694dc8b7e55 tempest-GroupSnapshotsTest-1932342766 None] Created reservations ['aa61ffe2-e130-4eef-8635-be4822422bdd', '2daf04b1-1e56-4342-8a35-c0e41f105c40', '628c4922-1e64-4502-b7dc-646889ec4dc0', 'e2795704-604d-4d1c-a37d-07cfb2d00d83'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:49:10 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-6efe8142-c962-4cf3-9fa2-e694dc8b7e55 tempest-GroupSnapshotsTest-1932342766 None] Created reservations ['cbe02cb9-5874-4638-ae5a-5280c0814451', 'c8e06cc8-6130-4a7f-9b00-abccac607293', '468dc870-b7a3-4519-87ca-6ad19cdb1c4b', 'dc1323cc-b4c2-4fe0-a9b2-f14ff1277d6e'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:49:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-6efe8142-c962-4cf3-9fa2-e694dc8b7e55 tempest-GroupSnapshotsTest-1932342766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:49:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-6efe8142-c962-4cf3-9fa2-e694dc8b7e55 tempest-GroupSnapshotsTest-1932342766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:49:10 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-6efe8142-c962-4cf3-9fa2-e694dc8b7e55 tempest-GroupSnapshotsTest-1932342766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:49:10 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-6efe8142-c962-4cf3-9fa2-e694dc8b7e55 tempest-GroupSnapshotsTest-1932342766 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:49:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-6efe8142-c962-4cf3-9fa2-e694dc8b7e55 tempest-GroupSnapshotsTest-1932342766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:49:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6efe8142-c962-4cf3-9fa2-e694dc8b7e55 tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6efe8142-c962-4cf3-9fa2-e694dc8b7e55 tempest-GroupSnapshotsTest-1932342766 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.117s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:10 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-6efe8142-c962-4cf3-9fa2-e694dc8b7e55 tempest-GroupSnapshotsTest-1932342766 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:49:10 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-6efe8142-c962-4cf3-9fa2-e694dc8b7e55 tempest-GroupSnapshotsTest-1932342766 None] Delete group completed successfully.
Sep 18 11:49:12 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-c5f659da-6c6f-4647-a617-fae996d5bdbe tempest-GroupSnapshotsTest-1932342766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:49:12 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-c5f659da-6c6f-4647-a617-fae996d5bdbe tempest-GroupSnapshotsTest-1932342766 None] Group tempest-GroupSnapshotsTest-Group-1453575514: creating
Sep 18 11:49:12 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-c5f659da-6c6f-4647-a617-fae996d5bdbe tempest-GroupSnapshotsTest-1932342766 None] Group tempest-GroupSnapshotsTest-Group-1453575514: created successfully
Sep 18 11:49:12 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-c5f659da-6c6f-4647-a617-fae996d5bdbe tempest-GroupSnapshotsTest-1932342766 None] Create group completed successfully.
Sep 18 11:49:13 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-1b384e22-ae73-448d-8543-ef52d794c6b3 tempest-GroupSnapshotsTest-1932342766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:49:13 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b384e22-ae73-448d-8543-ef52d794c6b3 tempest-GroupSnapshotsTest-1932342766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:49:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1b384e22-ae73-448d-8543-ef52d794c6b3 tempest-GroupSnapshotsTest-1932342766 None] Flow 'volume_create_manager' (37db6957-3646-4c48-87ea-4712b8dcac20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:49:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1b384e22-ae73-448d-8543-ef52d794c6b3 tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5044b372-4ece-43d2-b5b9-2e9a2ba6697e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:49:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1b384e22-ae73-448d-8543-ef52d794c6b3 tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5044b372-4ece-43d2-b5b9-2e9a2ba6697e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:49:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-680059087',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=79e54884-1726-4c69-bb4f-a95b3f21e660,host='devstack@QuobyteHD#QuobyteHD',id=26686824-80e2-4f2a-b0ca-377b67aefbd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d94ae722052445ebceafeb6b2a04307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:49:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:49:14Z,use_quota=True,user_id='ec81defb136b46b2aeead6ca3de965e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(19109cd7-a0bb-47af-9819-954e7d0287f8),volume_type_id=19109cd7-a0bb-47af-9819-954e7d0287f8)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:49:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1b384e22-ae73-448d-8543-ef52d794c6b3 tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (713a6f97-242d-4d4a-9968-4de307796786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:49:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1b384e22-ae73-448d-8543-ef52d794c6b3 tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (713a6f97-242d-4d4a-9968-4de307796786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:49:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1b384e22-ae73-448d-8543-ef52d794c6b3 tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6415230-5219-447f-986c-68e7b7c03474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:49:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1b384e22-ae73-448d-8543-ef52d794c6b3 tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6415230-5219-447f-986c-68e7b7c03474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26686824-80e2-4f2a-b0ca-377b67aefbd1', 'volume_name': 'volume-26686824-80e2-4f2a-b0ca-377b67aefbd1', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:49:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1b384e22-ae73-448d-8543-ef52d794c6b3 tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5883be50-3453-47f2-99a3-9f055b0122fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:49:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1b384e22-ae73-448d-8543-ef52d794c6b3 tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5883be50-3453-47f2-99a3-9f055b0122fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:49:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1b384e22-ae73-448d-8543-ef52d794c6b3 tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1eebf99-1f79-4cf1-8c3e-00d483f41542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:49:13 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-1b384e22-ae73-448d-8543-ef52d794c6b3 tempest-GroupSnapshotsTest-1932342766 None] Volume 26686824-80e2-4f2a-b0ca-377b67aefbd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26686824-80e2-4f2a-b0ca-377b67aefbd1', 'volume_size': 1}
Sep 18 11:49:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1b384e22-ae73-448d-8543-ef52d794c6b3 tempest-GroupSnapshotsTest-1932342766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:49:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1b384e22-ae73-448d-8543-ef52d794c6b3 tempest-GroupSnapshotsTest-1932342766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:49:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-1b384e22-ae73-448d-8543-ef52d794c6b3 tempest-GroupSnapshotsTest-1932342766 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=79e54884-1726-4c69-bb4f-a95b3f21e660,created_at=2025-09-18T09:49:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-680059087',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=79e54884-1726-4c69-bb4f-a95b3f21e660,host='devstack@QuobyteHD#QuobyteHD',id=26686824-80e2-4f2a-b0ca-377b67aefbd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d94ae722052445ebceafeb6b2a04307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:49:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:49:14Z,use_quota=True,user_id='ec81defb136b46b2aeead6ca3de965e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(19109cd7-a0bb-47af-9819-954e7d0287f8),volume_type_id=19109cd7-a0bb-47af-9819-954e7d0287f8)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:49:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-1b384e22-ae73-448d-8543-ef52d794c6b3 tempest-GroupSnapshotsTest-1932342766 None] Creating volume 26686824-80e2-4f2a-b0ca-377b67aefbd1 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:49:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1b384e22-ae73-448d-8543-ef52d794c6b3 tempest-GroupSnapshotsTest-1932342766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:49:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1b384e22-ae73-448d-8543-ef52d794c6b3 tempest-GroupSnapshotsTest-1932342766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:49:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-1b384e22-ae73-448d-8543-ef52d794c6b3 tempest-GroupSnapshotsTest-1932342766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:49:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-1b384e22-ae73-448d-8543-ef52d794c6b3 tempest-GroupSnapshotsTest-1932342766 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:49:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1b384e22-ae73-448d-8543-ef52d794c6b3 tempest-GroupSnapshotsTest-1932342766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:49:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-1b384e22-ae73-448d-8543-ef52d794c6b3 tempest-GroupSnapshotsTest-1932342766 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:49:13 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-1b384e22-ae73-448d-8543-ef52d794c6b3 tempest-GroupSnapshotsTest-1932342766 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:49:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1b384e22-ae73-448d-8543-ef52d794c6b3 tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-26686824-80e2-4f2a-b0ca-377b67aefbd1 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:13 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 11:49:13 devstack quobyte-client[83193]: System call of process 94063 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:49:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:49:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:49:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:49:13 devstack quobyte-client[83193]: System call of process 94063 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:49:13 devstack quobyte-client[83193]: System call of process 94063 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:49:13 devstack quobyte-client[83193]: System call of process 94063 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:49:13 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=70, name=volume-26686824-80e2-4f2a-b0ca-377b67aefbd1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:49:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:49:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:49:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.190s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:14 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:49:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1b384e22-ae73-448d-8543-ef52d794c6b3 tempest-GroupSnapshotsTest-1932342766 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-26686824-80e2-4f2a-b0ca-377b67aefbd1 1073741824" returned: 0 in 0.512s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1b384e22-ae73-448d-8543-ef52d794c6b3 tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-26686824-80e2-4f2a-b0ca-377b67aefbd1 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1b384e22-ae73-448d-8543-ef52d794c6b3 tempest-GroupSnapshotsTest-1932342766 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-26686824-80e2-4f2a-b0ca-377b67aefbd1" returned: 0 in 0.093s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-1b384e22-ae73-448d-8543-ef52d794c6b3 tempest-GroupSnapshotsTest-1932342766 None] <== create_volume: return (653ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:49:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1b384e22-ae73-448d-8543-ef52d794c6b3 tempest-GroupSnapshotsTest-1932342766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.665s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:49:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1b384e22-ae73-448d-8543-ef52d794c6b3 tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1eebf99-1f79-4cf1-8c3e-00d483f41542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26686824-80e2-4f2a-b0ca-377b67aefbd1', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:49:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1b384e22-ae73-448d-8543-ef52d794c6b3 tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13e8a7ac-d758-49dc-bb00-583855385925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:49:14 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-1b384e22-ae73-448d-8543-ef52d794c6b3 tempest-GroupSnapshotsTest-1932342766 None] Volume volume-26686824-80e2-4f2a-b0ca-377b67aefbd1 (26686824-80e2-4f2a-b0ca-377b67aefbd1): created successfully
Sep 18 11:49:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1b384e22-ae73-448d-8543-ef52d794c6b3 tempest-GroupSnapshotsTest-1932342766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13e8a7ac-d758-49dc-bb00-583855385925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:49:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1b384e22-ae73-448d-8543-ef52d794c6b3 tempest-GroupSnapshotsTest-1932342766 None] Flow 'volume_create_manager' (37db6957-3646-4c48-87ea-4712b8dcac20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:49:14 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-1b384e22-ae73-448d-8543-ef52d794c6b3 tempest-GroupSnapshotsTest-1932342766 None] Created volume successfully.
Sep 18 11:49:16 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-ecd5ad81-ea6c-48e6-a352-68bf755a4f85 tempest-GroupSnapshotsTest-1932342766 None] GroupSnapshot 2385cd86-d4f6-414f-b1a6-efc7c87a95a4: creating.
Sep 18 11:49:16 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-ecd5ad81-ea6c-48e6-a352-68bf755a4f85 tempest-GroupSnapshotsTest-1932342766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:49:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ecd5ad81-ea6c-48e6-a352-68bf755a4f85 tempest-GroupSnapshotsTest-1932342766 None] Group snapshot 2385cd86-d4f6-414f-b1a6-efc7c87a95a4: creating. {{(pid=83176) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 18 11:49:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ecd5ad81-ea6c-48e6-a352-68bf755a4f85 tempest-GroupSnapshotsTest-1932342766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:49:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ecd5ad81-ea6c-48e6-a352-68bf755a4f85 tempest-GroupSnapshotsTest-1932342766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:49:16 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-ecd5ad81-ea6c-48e6-a352-68bf755a4f85 tempest-GroupSnapshotsTest-1932342766 None] Creating offline snapshot 622a5143-37e5-4e7c-bd3d-2aea9419d84f of volume 26686824-80e2-4f2a-b0ca-377b67aefbd1 {{(pid=83176) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 11:49:16 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbe6fee-4a17-47b5-83d0-66fd1eb64624]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:49:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ecd5ad81-ea6c-48e6-a352-68bf755a4f85 tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-26686824-80e2-4f2a-b0ca-377b67aefbd1 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ecd5ad81-ea6c-48e6-a352-68bf755a4f85 tempest-GroupSnapshotsTest-1932342766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-26686824-80e2-4f2a-b0ca-377b67aefbd1" returned: 0 in 0.465s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ecd5ad81-ea6c-48e6-a352-68bf755a4f85 tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-26686824-80e2-4f2a-b0ca-377b67aefbd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-26686824-80e2-4f2a-b0ca-377b67aefbd1.622a5143-37e5-4e7c-bd3d-2aea9419d84f 1G {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:16 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=71, name=volume-26686824-80e2-4f2a-b0ca-377b67aefbd1.622a5143-37e5-4e7c-bd3d-2aea9419d84f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:49:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ecd5ad81-ea6c-48e6-a352-68bf755a4f85 tempest-GroupSnapshotsTest-1932342766 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-26686824-80e2-4f2a-b0ca-377b67aefbd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-26686824-80e2-4f2a-b0ca-377b67aefbd1.622a5143-37e5-4e7c-bd3d-2aea9419d84f 1G" returned: 0 in 0.250s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ecd5ad81-ea6c-48e6-a352-68bf755a4f85 tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): qemu-img rebase -u -b volume-26686824-80e2-4f2a-b0ca-377b67aefbd1 -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-26686824-80e2-4f2a-b0ca-377b67aefbd1.622a5143-37e5-4e7c-bd3d-2aea9419d84f {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ecd5ad81-ea6c-48e6-a352-68bf755a4f85 tempest-GroupSnapshotsTest-1932342766 None] CMD "qemu-img rebase -u -b volume-26686824-80e2-4f2a-b0ca-377b67aefbd1 -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-26686824-80e2-4f2a-b0ca-377b67aefbd1.622a5143-37e5-4e7c-bd3d-2aea9419d84f" returned: 0 in 0.151s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:17 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-ecd5ad81-ea6c-48e6-a352-68bf755a4f85 tempest-GroupSnapshotsTest-1932342766 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-26686824-80e2-4f2a-b0ca-377b67aefbd1.622a5143-37e5-4e7c-bd3d-2aea9419d84f is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 11:49:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ecd5ad81-ea6c-48e6-a352-68bf755a4f85 tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-26686824-80e2-4f2a-b0ca-377b67aefbd1.622a5143-37e5-4e7c-bd3d-2aea9419d84f {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ecd5ad81-ea6c-48e6-a352-68bf755a4f85 tempest-GroupSnapshotsTest-1932342766 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-26686824-80e2-4f2a-b0ca-377b67aefbd1.622a5143-37e5-4e7c-bd3d-2aea9419d84f" returned: 0 in 0.090s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:17 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-ecd5ad81-ea6c-48e6-a352-68bf755a4f85 tempest-GroupSnapshotsTest-1932342766 None] Setting permissions: /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-26686824-80e2-4f2a-b0ca-377b67aefbd1 -> 1000:1000 {{(pid=83176) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 11:49:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ecd5ad81-ea6c-48e6-a352-68bf755a4f85 tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-26686824-80e2-4f2a-b0ca-377b67aefbd1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-26686824-80e2-4f2a-b0ca-377b67aefbd1.622a5143-37e5-4e7c-bd3d-2aea9419d84f {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ecd5ad81-ea6c-48e6-a352-68bf755a4f85 tempest-GroupSnapshotsTest-1932342766 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-26686824-80e2-4f2a-b0ca-377b67aefbd1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-26686824-80e2-4f2a-b0ca-377b67aefbd1.622a5143-37e5-4e7c-bd3d-2aea9419d84f" returned: 0 in 0.129s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ecd5ad81-ea6c-48e6-a352-68bf755a4f85 tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-26686824-80e2-4f2a-b0ca-377b67aefbd1.info {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ecd5ad81-ea6c-48e6-a352-68bf755a4f85 tempest-GroupSnapshotsTest-1932342766 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-26686824-80e2-4f2a-b0ca-377b67aefbd1.info" returned: 0 in 0.108s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:17 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-ecd5ad81-ea6c-48e6-a352-68bf755a4f85 tempest-GroupSnapshotsTest-1932342766 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-26686824-80e2-4f2a-b0ca-377b67aefbd1.info is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 11:49:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ecd5ad81-ea6c-48e6-a352-68bf755a4f85 tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-26686824-80e2-4f2a-b0ca-377b67aefbd1.info {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ecd5ad81-ea6c-48e6-a352-68bf755a4f85 tempest-GroupSnapshotsTest-1932342766 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-26686824-80e2-4f2a-b0ca-377b67aefbd1.info" returned: 0 in 0.083s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ecd5ad81-ea6c-48e6-a352-68bf755a4f85 tempest-GroupSnapshotsTest-1932342766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.599s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:49:18 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-ecd5ad81-ea6c-48e6-a352-68bf755a4f85 tempest-GroupSnapshotsTest-1932342766 None] group_snapshot 2385cd86-d4f6-414f-b1a6-efc7c87a95a4: created successfully
Sep 18 11:49:18 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-fc9b8ba4-56d7-47e5-bf7e-71ecb46f907a tempest-GroupSnapshotsTest-1932342766 None] group_snapshot 2385cd86-d4f6-414f-b1a6-efc7c87a95a4: deleting
Sep 18 11:49:18 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-fc9b8ba4-56d7-47e5-bf7e-71ecb46f907a tempest-GroupSnapshotsTest-1932342766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:49:18 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-fc9b8ba4-56d7-47e5-bf7e-71ecb46f907a tempest-GroupSnapshotsTest-1932342766 None] group_snapshot 2385cd86-d4f6-414f-b1a6-efc7c87a95a4: deleting {{(pid=83176) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 18 11:49:18 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-fc9b8ba4-56d7-47e5-bf7e-71ecb46f907a tempest-GroupSnapshotsTest-1932342766 None] Acquiring lock "cinder-quobyte-26686824-80e2-4f2a-b0ca-377b67aefbd1" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:49:18 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-fc9b8ba4-56d7-47e5-bf7e-71ecb46f907a tempest-GroupSnapshotsTest-1932342766 None] Lock "cinder-quobyte-26686824-80e2-4f2a-b0ca-377b67aefbd1" acquired by "delete_snapshot" :: waited 0.079s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:49:18 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-fc9b8ba4-56d7-47e5-bf7e-71ecb46f907a tempest-GroupSnapshotsTest-1932342766 None] Acquiring lock "cinder-quobyte-622a5143-37e5-4e7c-bd3d-2aea9419d84f" by "_delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:49:18 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-fc9b8ba4-56d7-47e5-bf7e-71ecb46f907a tempest-GroupSnapshotsTest-1932342766 None] Lock "cinder-quobyte-622a5143-37e5-4e7c-bd3d-2aea9419d84f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:49:18 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-fc9b8ba4-56d7-47e5-bf7e-71ecb46f907a tempest-GroupSnapshotsTest-1932342766 None] Deleting offline snapshot 622a5143-37e5-4e7c-bd3d-2aea9419d84f of volume 26686824-80e2-4f2a-b0ca-377b67aefbd1 {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 11:49:18 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-fc9b8ba4-56d7-47e5-bf7e-71ecb46f907a tempest-GroupSnapshotsTest-1932342766 None] snapshot_file for this snap is: volume-26686824-80e2-4f2a-b0ca-377b67aefbd1.622a5143-37e5-4e7c-bd3d-2aea9419d84f {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 11:49:18 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a543211-5175-4a0e-b9f7-bb70dfeb165f]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:49:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fc9b8ba4-56d7-47e5-bf7e-71ecb46f907a tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-26686824-80e2-4f2a-b0ca-377b67aefbd1.622a5143-37e5-4e7c-bd3d-2aea9419d84f {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fc9b8ba4-56d7-47e5-bf7e-71ecb46f907a tempest-GroupSnapshotsTest-1932342766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-26686824-80e2-4f2a-b0ca-377b67aefbd1.622a5143-37e5-4e7c-bd3d-2aea9419d84f" returned: 0 in 0.426s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:19 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-fc9b8ba4-56d7-47e5-bf7e-71ecb46f907a tempest-GroupSnapshotsTest-1932342766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26686824-80e2-4f2a-b0ca-377b67aefbd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 11:49:19 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[04da3af6-e6f2-4320-bbb4-de2c6a2c7ca5]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:49:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fc9b8ba4-56d7-47e5-bf7e-71ecb46f907a tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-26686824-80e2-4f2a-b0ca-377b67aefbd1 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fc9b8ba4-56d7-47e5-bf7e-71ecb46f907a tempest-GroupSnapshotsTest-1932342766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-26686824-80e2-4f2a-b0ca-377b67aefbd1" returned: 0 in 0.414s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fc9b8ba4-56d7-47e5-bf7e-71ecb46f907a tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-26686824-80e2-4f2a-b0ca-377b67aefbd1.622a5143-37e5-4e7c-bd3d-2aea9419d84f {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fc9b8ba4-56d7-47e5-bf7e-71ecb46f907a tempest-GroupSnapshotsTest-1932342766 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-26686824-80e2-4f2a-b0ca-377b67aefbd1.622a5143-37e5-4e7c-bd3d-2aea9419d84f" returned: 0 in 0.217s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fc9b8ba4-56d7-47e5-bf7e-71ecb46f907a tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-26686824-80e2-4f2a-b0ca-377b67aefbd1.622a5143-37e5-4e7c-bd3d-2aea9419d84f {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fc9b8ba4-56d7-47e5-bf7e-71ecb46f907a tempest-GroupSnapshotsTest-1932342766 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-26686824-80e2-4f2a-b0ca-377b67aefbd1.622a5143-37e5-4e7c-bd3d-2aea9419d84f" returned: 0 in 0.083s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:20 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-fc9b8ba4-56d7-47e5-bf7e-71ecb46f907a tempest-GroupSnapshotsTest-1932342766 None] Lock "cinder-quobyte-622a5143-37e5-4e7c-bd3d-2aea9419d84f" released by "_delete_snapshot" :: held 1.458s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:49:20 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-fc9b8ba4-56d7-47e5-bf7e-71ecb46f907a tempest-GroupSnapshotsTest-1932342766 None] Lock "cinder-quobyte-26686824-80e2-4f2a-b0ca-377b67aefbd1" released by "delete_snapshot" :: held 1.491s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:49:20 devstack cinder-volume[83176]: WARNING cinder.quota [None req-fc9b8ba4-56d7-47e5-bf7e-71ecb46f907a tempest-GroupSnapshotsTest-1932342766 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1830663581 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1830663581, it is now deprecated. Please use the default quota class for default quota.
Sep 18 11:49:20 devstack cinder-volume[83176]: WARNING cinder.quota [None req-fc9b8ba4-56d7-47e5-bf7e-71ecb46f907a tempest-GroupSnapshotsTest-1932342766 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1830663581 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1830663581, it is now deprecated. Please use the default quota class for default quota.
Sep 18 11:49:20 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-fc9b8ba4-56d7-47e5-bf7e-71ecb46f907a tempest-GroupSnapshotsTest-1932342766 None] Created reservations ['11cce8fc-38d2-44bd-8418-01ab4872c2d9', 'aa72a5d0-790a-426a-b983-fdd98694bf5b', '98a5baa5-25fe-4adb-bd16-bec0ae3e5e14', 'c5c50e45-37a0-44b3-96b1-4b7bc41f1337'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:49:20 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-fc9b8ba4-56d7-47e5-bf7e-71ecb46f907a tempest-GroupSnapshotsTest-1932342766 None] group_snapshot 2385cd86-d4f6-414f-b1a6-efc7c87a95a4: deleted successfully
Sep 18 11:49:21 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-6cd35bf5-79c7-43f5-91a1-467015790167 tempest-GroupSnapshotsTest-1932342766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:49:21 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-6cd35bf5-79c7-43f5-91a1-467015790167 tempest-GroupSnapshotsTest-1932342766 None] Acquiring lock "cinder-quobyte-26686824-80e2-4f2a-b0ca-377b67aefbd1" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:49:21 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-6cd35bf5-79c7-43f5-91a1-467015790167 tempest-GroupSnapshotsTest-1932342766 None] Lock "cinder-quobyte-26686824-80e2-4f2a-b0ca-377b67aefbd1" acquired by "delete_volume" :: waited 0.037s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:49:21 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e783e029-6541-425e-b0a0-8bbb05509413]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:49:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6cd35bf5-79c7-43f5-91a1-467015790167 tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-26686824-80e2-4f2a-b0ca-377b67aefbd1 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6cd35bf5-79c7-43f5-91a1-467015790167 tempest-GroupSnapshotsTest-1932342766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-26686824-80e2-4f2a-b0ca-377b67aefbd1" returned: 0 in 0.471s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6cd35bf5-79c7-43f5-91a1-467015790167 tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-26686824-80e2-4f2a-b0ca-377b67aefbd1 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6cd35bf5-79c7-43f5-91a1-467015790167 tempest-GroupSnapshotsTest-1932342766 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-26686824-80e2-4f2a-b0ca-377b67aefbd1" returned: 0 in 0.093s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:22 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-6cd35bf5-79c7-43f5-91a1-467015790167 tempest-GroupSnapshotsTest-1932342766 None] Lock "cinder-quobyte-26686824-80e2-4f2a-b0ca-377b67aefbd1" released by "delete_volume" :: held 0.745s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:49:22 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-6cd35bf5-79c7-43f5-91a1-467015790167 tempest-GroupSnapshotsTest-1932342766 None] Created reservations ['a2541387-f3fe-4b76-a62d-cb036ecd4032'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:49:22 devstack cinder-volume[83176]: WARNING cinder.quota [None req-6cd35bf5-79c7-43f5-91a1-467015790167 tempest-GroupSnapshotsTest-1932342766 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1830663581 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1830663581, it is now deprecated. Please use the default quota class for default quota.
Sep 18 11:49:22 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-6cd35bf5-79c7-43f5-91a1-467015790167 tempest-GroupSnapshotsTest-1932342766 None] Created reservations ['3850b89f-a62d-4c6c-9beb-4c8f8b415e73', '68bb9fd5-008f-4e68-98d5-939d884e5819', 'a4db73ac-dfb2-47cd-aeb9-61e5af62a617', 'eb246af8-137f-4173-acb9-418645b1db68'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:49:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-6cd35bf5-79c7-43f5-91a1-467015790167 tempest-GroupSnapshotsTest-1932342766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:49:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-6cd35bf5-79c7-43f5-91a1-467015790167 tempest-GroupSnapshotsTest-1932342766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:49:22 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-6cd35bf5-79c7-43f5-91a1-467015790167 tempest-GroupSnapshotsTest-1932342766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:49:22 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-6cd35bf5-79c7-43f5-91a1-467015790167 tempest-GroupSnapshotsTest-1932342766 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:49:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-6cd35bf5-79c7-43f5-91a1-467015790167 tempest-GroupSnapshotsTest-1932342766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:49:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6cd35bf5-79c7-43f5-91a1-467015790167 tempest-GroupSnapshotsTest-1932342766 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6cd35bf5-79c7-43f5-91a1-467015790167 tempest-GroupSnapshotsTest-1932342766 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.089s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:22 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-6cd35bf5-79c7-43f5-91a1-467015790167 tempest-GroupSnapshotsTest-1932342766 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:49:22 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-6cd35bf5-79c7-43f5-91a1-467015790167 tempest-GroupSnapshotsTest-1932342766 None] Delete group completed successfully.
Sep 18 11:49:32 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=98,cinder:UPDATE=91,cinder:INSERT=16,cinder:DELETE=3 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:49:32 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=92,cinder:UPDATE=93,cinder:INSERT=24 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:49:41 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-3f5168be-96ac-4dfe-9576-a6e864f1045c tempest-GroupsTest-690885280 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:49:41 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-3f5168be-96ac-4dfe-9576-a6e864f1045c tempest-GroupsTest-690885280 None] Group tempest-Group1-908883602: creating
Sep 18 11:49:41 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-3f5168be-96ac-4dfe-9576-a6e864f1045c tempest-GroupsTest-690885280 None] Group tempest-Group1-908883602: created successfully
Sep 18 11:49:41 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-3f5168be-96ac-4dfe-9576-a6e864f1045c tempest-GroupsTest-690885280 None] Create group completed successfully.
Sep 18 11:49:42 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-9bee6f07-a703-42e6-b72a-aafd5e12d8c6 tempest-GroupsTest-690885280 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:49:42 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-9bee6f07-a703-42e6-b72a-aafd5e12d8c6 tempest-GroupsTest-690885280 None] Group tempest-Group2-1498897681: creating
Sep 18 11:49:42 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-9bee6f07-a703-42e6-b72a-aafd5e12d8c6 tempest-GroupsTest-690885280 None] Group tempest-Group2-1498897681: created successfully
Sep 18 11:49:42 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-9bee6f07-a703-42e6-b72a-aafd5e12d8c6 tempest-GroupsTest-690885280 None] Create group completed successfully.
Sep 18 11:49:44 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-57193360-7df7-4bc0-a54b-32078255b214 tempest-GroupsTest-690885280 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:49:44 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-57193360-7df7-4bc0-a54b-32078255b214 tempest-GroupsTest-690885280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:49:44 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-57193360-7df7-4bc0-a54b-32078255b214 tempest-GroupsTest-690885280 None] Flow 'volume_create_manager' (79ece573-1835-430d-b0b0-0cd057058a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:49:44 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-57193360-7df7-4bc0-a54b-32078255b214 tempest-GroupsTest-690885280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38868977-8567-4a1c-9e06-956091424f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:49:44 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-57193360-7df7-4bc0-a54b-32078255b214 tempest-GroupsTest-690885280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38868977-8567-4a1c-9e06-956091424f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1999856474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e1999687-7582-4baf-8972-f266dcbb7477,host='devstack@QuobyteHD#QuobyteHD',id=d17ed8ef-bbe8-45b8-9580-808b6dfbe8dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9b046db647b406ea4d07f70cba7b000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:49:44Z,use_quota=True,user_id='d300da98006c44ccad613eb7861496cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(349d6f39-2b85-451f-8082-99529fa5e977),volume_type_id=349d6f39-2b85-451f-8082-99529fa5e977)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:49:44 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-57193360-7df7-4bc0-a54b-32078255b214 tempest-GroupsTest-690885280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c158c375-bfbc-4ec8-a813-7eef071a58dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:49:44 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-57193360-7df7-4bc0-a54b-32078255b214 tempest-GroupsTest-690885280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c158c375-bfbc-4ec8-a813-7eef071a58dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:49:44 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-57193360-7df7-4bc0-a54b-32078255b214 tempest-GroupsTest-690885280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b33660c0-8524-4fcb-9311-ffb0054ac133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:49:44 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-57193360-7df7-4bc0-a54b-32078255b214 tempest-GroupsTest-690885280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b33660c0-8524-4fcb-9311-ffb0054ac133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd17ed8ef-bbe8-45b8-9580-808b6dfbe8dc', 'volume_name': 'volume-d17ed8ef-bbe8-45b8-9580-808b6dfbe8dc', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:49:44 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-57193360-7df7-4bc0-a54b-32078255b214 tempest-GroupsTest-690885280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (945f8782-1be8-47f3-bfb8-96ba3db10c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:49:44 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-57193360-7df7-4bc0-a54b-32078255b214 tempest-GroupsTest-690885280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (945f8782-1be8-47f3-bfb8-96ba3db10c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:49:44 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-57193360-7df7-4bc0-a54b-32078255b214 tempest-GroupsTest-690885280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5233e5cc-a719-4397-b067-21109c7e7b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:49:44 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-57193360-7df7-4bc0-a54b-32078255b214 tempest-GroupsTest-690885280 None] Volume d17ed8ef-bbe8-45b8-9580-808b6dfbe8dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d17ed8ef-bbe8-45b8-9580-808b6dfbe8dc', 'volume_size': 1}
Sep 18 11:49:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-57193360-7df7-4bc0-a54b-32078255b214 tempest-GroupsTest-690885280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:49:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-57193360-7df7-4bc0-a54b-32078255b214 tempest-GroupsTest-690885280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:49:44 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-57193360-7df7-4bc0-a54b-32078255b214 tempest-GroupsTest-690885280 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=e1999687-7582-4baf-8972-f266dcbb7477,created_at=2025-09-18T09:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1999856474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e1999687-7582-4baf-8972-f266dcbb7477,host='devstack@QuobyteHD#QuobyteHD',id=d17ed8ef-bbe8-45b8-9580-808b6dfbe8dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9b046db647b406ea4d07f70cba7b000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:49:44Z,use_quota=True,user_id='d300da98006c44ccad613eb7861496cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(349d6f39-2b85-451f-8082-99529fa5e977),volume_type_id=349d6f39-2b85-451f-8082-99529fa5e977)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:49:44 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-57193360-7df7-4bc0-a54b-32078255b214 tempest-GroupsTest-690885280 None] Creating volume d17ed8ef-bbe8-45b8-9580-808b6dfbe8dc {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:49:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-57193360-7df7-4bc0-a54b-32078255b214 tempest-GroupsTest-690885280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:49:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-57193360-7df7-4bc0-a54b-32078255b214 tempest-GroupsTest-690885280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:49:44 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-57193360-7df7-4bc0-a54b-32078255b214 tempest-GroupsTest-690885280 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:49:44 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-57193360-7df7-4bc0-a54b-32078255b214 tempest-GroupsTest-690885280 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:49:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-57193360-7df7-4bc0-a54b-32078255b214 tempest-GroupsTest-690885280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:49:44 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-57193360-7df7-4bc0-a54b-32078255b214 tempest-GroupsTest-690885280 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:49:44 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-57193360-7df7-4bc0-a54b-32078255b214 tempest-GroupsTest-690885280 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:49:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-57193360-7df7-4bc0-a54b-32078255b214 tempest-GroupsTest-690885280 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d17ed8ef-bbe8-45b8-9580-808b6dfbe8dc 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:44 devstack quobyte-client[83193]: System call of process 94161 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:49:44 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=73, name=volume-d17ed8ef-bbe8-45b8-9580-808b6dfbe8dc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:49:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-57193360-7df7-4bc0-a54b-32078255b214 tempest-GroupsTest-690885280 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d17ed8ef-bbe8-45b8-9580-808b6dfbe8dc 1073741824" returned: 0 in 0.423s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-57193360-7df7-4bc0-a54b-32078255b214 tempest-GroupsTest-690885280 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d17ed8ef-bbe8-45b8-9580-808b6dfbe8dc {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:45 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-57193360-7df7-4bc0-a54b-32078255b214 tempest-GroupsTest-690885280 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d17ed8ef-bbe8-45b8-9580-808b6dfbe8dc" returned: 0 in 0.118s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:45 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-57193360-7df7-4bc0-a54b-32078255b214 tempest-GroupsTest-690885280 None] <== create_volume: return (614ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:49:45 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-57193360-7df7-4bc0-a54b-32078255b214 tempest-GroupsTest-690885280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.627s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:49:45 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-57193360-7df7-4bc0-a54b-32078255b214 tempest-GroupsTest-690885280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5233e5cc-a719-4397-b067-21109c7e7b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d17ed8ef-bbe8-45b8-9580-808b6dfbe8dc', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:49:45 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-57193360-7df7-4bc0-a54b-32078255b214 tempest-GroupsTest-690885280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2478ac97-606a-4952-963e-8fb380999950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:49:45 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-57193360-7df7-4bc0-a54b-32078255b214 tempest-GroupsTest-690885280 None] Volume volume-d17ed8ef-bbe8-45b8-9580-808b6dfbe8dc (d17ed8ef-bbe8-45b8-9580-808b6dfbe8dc): created successfully
Sep 18 11:49:45 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-57193360-7df7-4bc0-a54b-32078255b214 tempest-GroupsTest-690885280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2478ac97-606a-4952-963e-8fb380999950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:49:45 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-57193360-7df7-4bc0-a54b-32078255b214 tempest-GroupsTest-690885280 None] Flow 'volume_create_manager' (79ece573-1835-430d-b0b0-0cd057058a1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:49:45 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-57193360-7df7-4bc0-a54b-32078255b214 tempest-GroupsTest-690885280 None] Created volume successfully.
Sep 18 11:49:47 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-41678e13-6e94-4d8d-b8d1-fce7d3e441e5 tempest-GroupsTest-690885280 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:49:47 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-41678e13-6e94-4d8d-b8d1-fce7d3e441e5 tempest-GroupsTest-690885280 None] Acquiring lock "cinder-quobyte-d17ed8ef-bbe8-45b8-9580-808b6dfbe8dc" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:49:47 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-41678e13-6e94-4d8d-b8d1-fce7d3e441e5 tempest-GroupsTest-690885280 None] Lock "cinder-quobyte-d17ed8ef-bbe8-45b8-9580-808b6dfbe8dc" acquired by "delete_volume" :: waited 0.041s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:49:47 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48cac04-05cc-4e54-b7aa-3a20d6311dee]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:49:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-41678e13-6e94-4d8d-b8d1-fce7d3e441e5 tempest-GroupsTest-690885280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d17ed8ef-bbe8-45b8-9580-808b6dfbe8dc {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-41678e13-6e94-4d8d-b8d1-fce7d3e441e5 tempest-GroupsTest-690885280 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d17ed8ef-bbe8-45b8-9580-808b6dfbe8dc" returned: 0 in 0.380s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-41678e13-6e94-4d8d-b8d1-fce7d3e441e5 tempest-GroupsTest-690885280 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d17ed8ef-bbe8-45b8-9580-808b6dfbe8dc {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-41678e13-6e94-4d8d-b8d1-fce7d3e441e5 tempest-GroupsTest-690885280 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d17ed8ef-bbe8-45b8-9580-808b6dfbe8dc" returned: 0 in 0.081s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:47 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-41678e13-6e94-4d8d-b8d1-fce7d3e441e5 tempest-GroupsTest-690885280 None] Lock "cinder-quobyte-d17ed8ef-bbe8-45b8-9580-808b6dfbe8dc" released by "delete_volume" :: held 0.612s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:49:48 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-41678e13-6e94-4d8d-b8d1-fce7d3e441e5 tempest-GroupsTest-690885280 None] Created reservations ['7f3116da-c68f-4707-84c9-f1d2b951bb63'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:49:48 devstack cinder-volume[83176]: WARNING cinder.quota [None req-41678e13-6e94-4d8d-b8d1-fce7d3e441e5 tempest-GroupsTest-690885280 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1553214814 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1553214814, it is now deprecated. Please use the default quota class for default quota.
Sep 18 11:49:48 devstack cinder-volume[83176]: WARNING cinder.quota [None req-41678e13-6e94-4d8d-b8d1-fce7d3e441e5 tempest-GroupsTest-690885280 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1553214814 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1553214814, it is now deprecated. Please use the default quota class for default quota.
Sep 18 11:49:48 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-41678e13-6e94-4d8d-b8d1-fce7d3e441e5 tempest-GroupsTest-690885280 None] Created reservations ['9e7d3050-7e5e-4d32-a625-de35631703e9', '1669a937-77be-41de-8dd6-1c070ebd9ca4', '4a8594d0-bf63-4b3e-9636-ca16eb809e84', '9e9721b4-5cda-467c-acd3-9bdbd82cac1d'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:49:48 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-41678e13-6e94-4d8d-b8d1-fce7d3e441e5 tempest-GroupsTest-690885280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:49:48 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-41678e13-6e94-4d8d-b8d1-fce7d3e441e5 tempest-GroupsTest-690885280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:49:48 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-41678e13-6e94-4d8d-b8d1-fce7d3e441e5 tempest-GroupsTest-690885280 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:49:48 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-41678e13-6e94-4d8d-b8d1-fce7d3e441e5 tempest-GroupsTest-690885280 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:49:48 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-41678e13-6e94-4d8d-b8d1-fce7d3e441e5 tempest-GroupsTest-690885280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:49:48 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-41678e13-6e94-4d8d-b8d1-fce7d3e441e5 tempest-GroupsTest-690885280 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:48 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-41678e13-6e94-4d8d-b8d1-fce7d3e441e5 tempest-GroupsTest-690885280 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.081s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:48 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-41678e13-6e94-4d8d-b8d1-fce7d3e441e5 tempest-GroupsTest-690885280 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:49:48 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-41678e13-6e94-4d8d-b8d1-fce7d3e441e5 tempest-GroupsTest-690885280 None] Delete group completed successfully.
Sep 18 11:49:49 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-258821dc-6bfa-48f1-85a7-3fdc2166fbf0 tempest-GroupsTest-690885280 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:49:49 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-258821dc-6bfa-48f1-85a7-3fdc2166fbf0 tempest-GroupsTest-690885280 None] Created reservations ['90c2b960-b3f5-4340-a8cb-98953acd1974'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:49:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-258821dc-6bfa-48f1-85a7-3fdc2166fbf0 tempest-GroupsTest-690885280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:49:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-258821dc-6bfa-48f1-85a7-3fdc2166fbf0 tempest-GroupsTest-690885280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:49:49 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-258821dc-6bfa-48f1-85a7-3fdc2166fbf0 tempest-GroupsTest-690885280 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:49:49 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-258821dc-6bfa-48f1-85a7-3fdc2166fbf0 tempest-GroupsTest-690885280 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:49:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-258821dc-6bfa-48f1-85a7-3fdc2166fbf0 tempest-GroupsTest-690885280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:49:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-258821dc-6bfa-48f1-85a7-3fdc2166fbf0 tempest-GroupsTest-690885280 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-258821dc-6bfa-48f1-85a7-3fdc2166fbf0 tempest-GroupsTest-690885280 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.103s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:49 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-258821dc-6bfa-48f1-85a7-3fdc2166fbf0 tempest-GroupsTest-690885280 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:49:49 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-258821dc-6bfa-48f1-85a7-3fdc2166fbf0 tempest-GroupsTest-690885280 None] Delete group completed successfully.
Sep 18 11:49:51 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-2bdd69b1-7ada-4d84-a1ad-1ceb5d699ca3 tempest-GroupsTest-690885280 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:49:51 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-2bdd69b1-7ada-4d84-a1ad-1ceb5d699ca3 tempest-GroupsTest-690885280 None] Group tempest-GroupsTest-Group-387268619: creating
Sep 18 11:49:51 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-2bdd69b1-7ada-4d84-a1ad-1ceb5d699ca3 tempest-GroupsTest-690885280 None] Group tempest-GroupsTest-Group-387268619: created successfully
Sep 18 11:49:51 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-2bdd69b1-7ada-4d84-a1ad-1ceb5d699ca3 tempest-GroupsTest-690885280 None] Create group completed successfully.
Sep 18 11:49:52 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-ab7b8c9e-b4b9-4fd1-8416-1a5263464b55 tempest-GroupsTest-690885280 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:49:52 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab7b8c9e-b4b9-4fd1-8416-1a5263464b55 tempest-GroupsTest-690885280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:49:52 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ab7b8c9e-b4b9-4fd1-8416-1a5263464b55 tempest-GroupsTest-690885280 None] Flow 'volume_create_manager' (139e8f49-a45e-4ff7-9ae4-e69b9b296dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:49:52 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ab7b8c9e-b4b9-4fd1-8416-1a5263464b55 tempest-GroupsTest-690885280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d7091d4-4eca-497c-97cf-58e9a0ceb356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:49:52 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ab7b8c9e-b4b9-4fd1-8416-1a5263464b55 tempest-GroupsTest-690885280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d7091d4-4eca-497c-97cf-58e9a0ceb356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-687017571',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7d97cf43-489d-42fc-99e3-c1192bc136c1,host='devstack@QuobyteHD#QuobyteHD',id=b6d2f739-2f6c-4269-9787-8a8d4a41b8af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9b046db647b406ea4d07f70cba7b000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:49:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:49:53Z,use_quota=True,user_id='d300da98006c44ccad613eb7861496cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7efbbad4-b4d5-4101-a135-74e2ddc45b59),volume_type_id=7efbbad4-b4d5-4101-a135-74e2ddc45b59)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:49:52 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ab7b8c9e-b4b9-4fd1-8416-1a5263464b55 tempest-GroupsTest-690885280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f02ffddd-2cb1-417b-99a7-184d6b7724d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:49:52 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ab7b8c9e-b4b9-4fd1-8416-1a5263464b55 tempest-GroupsTest-690885280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f02ffddd-2cb1-417b-99a7-184d6b7724d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:49:52 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ab7b8c9e-b4b9-4fd1-8416-1a5263464b55 tempest-GroupsTest-690885280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d091bd21-959e-4949-aa9d-82d63fb6b1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:49:52 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ab7b8c9e-b4b9-4fd1-8416-1a5263464b55 tempest-GroupsTest-690885280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d091bd21-959e-4949-aa9d-82d63fb6b1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6d2f739-2f6c-4269-9787-8a8d4a41b8af', 'volume_name': 'volume-b6d2f739-2f6c-4269-9787-8a8d4a41b8af', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:49:52 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ab7b8c9e-b4b9-4fd1-8416-1a5263464b55 tempest-GroupsTest-690885280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e2edf17-6bc7-4d36-b2e6-110b2e5bf0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:49:52 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ab7b8c9e-b4b9-4fd1-8416-1a5263464b55 tempest-GroupsTest-690885280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e2edf17-6bc7-4d36-b2e6-110b2e5bf0b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:49:52 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ab7b8c9e-b4b9-4fd1-8416-1a5263464b55 tempest-GroupsTest-690885280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b383f03e-ee73-467f-af8e-3b253a9021ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:49:52 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-ab7b8c9e-b4b9-4fd1-8416-1a5263464b55 tempest-GroupsTest-690885280 None] Volume b6d2f739-2f6c-4269-9787-8a8d4a41b8af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6d2f739-2f6c-4269-9787-8a8d4a41b8af', 'volume_size': 1}
Sep 18 11:49:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ab7b8c9e-b4b9-4fd1-8416-1a5263464b55 tempest-GroupsTest-690885280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:49:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ab7b8c9e-b4b9-4fd1-8416-1a5263464b55 tempest-GroupsTest-690885280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:49:52 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-ab7b8c9e-b4b9-4fd1-8416-1a5263464b55 tempest-GroupsTest-690885280 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7d97cf43-489d-42fc-99e3-c1192bc136c1,created_at=2025-09-18T09:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-687017571',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7d97cf43-489d-42fc-99e3-c1192bc136c1,host='devstack@QuobyteHD#QuobyteHD',id=b6d2f739-2f6c-4269-9787-8a8d4a41b8af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9b046db647b406ea4d07f70cba7b000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:49:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:49:53Z,use_quota=True,user_id='d300da98006c44ccad613eb7861496cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7efbbad4-b4d5-4101-a135-74e2ddc45b59),volume_type_id=7efbbad4-b4d5-4101-a135-74e2ddc45b59)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:49:52 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-ab7b8c9e-b4b9-4fd1-8416-1a5263464b55 tempest-GroupsTest-690885280 None] Creating volume b6d2f739-2f6c-4269-9787-8a8d4a41b8af {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:49:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ab7b8c9e-b4b9-4fd1-8416-1a5263464b55 tempest-GroupsTest-690885280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:49:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ab7b8c9e-b4b9-4fd1-8416-1a5263464b55 tempest-GroupsTest-690885280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:49:52 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-ab7b8c9e-b4b9-4fd1-8416-1a5263464b55 tempest-GroupsTest-690885280 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:49:52 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-ab7b8c9e-b4b9-4fd1-8416-1a5263464b55 tempest-GroupsTest-690885280 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:49:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ab7b8c9e-b4b9-4fd1-8416-1a5263464b55 tempest-GroupsTest-690885280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:49:52 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-ab7b8c9e-b4b9-4fd1-8416-1a5263464b55 tempest-GroupsTest-690885280 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:49:52 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-ab7b8c9e-b4b9-4fd1-8416-1a5263464b55 tempest-GroupsTest-690885280 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:49:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ab7b8c9e-b4b9-4fd1-8416-1a5263464b55 tempest-GroupsTest-690885280 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b6d2f739-2f6c-4269-9787-8a8d4a41b8af 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:53 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=74, name=volume-b6d2f739-2f6c-4269-9787-8a8d4a41b8af, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:49:53 devstack quobyte-client[83193]: System call of process 94172 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:49:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ab7b8c9e-b4b9-4fd1-8416-1a5263464b55 tempest-GroupsTest-690885280 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b6d2f739-2f6c-4269-9787-8a8d4a41b8af 1073741824" returned: 0 in 0.326s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ab7b8c9e-b4b9-4fd1-8416-1a5263464b55 tempest-GroupsTest-690885280 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b6d2f739-2f6c-4269-9787-8a8d4a41b8af {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ab7b8c9e-b4b9-4fd1-8416-1a5263464b55 tempest-GroupsTest-690885280 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b6d2f739-2f6c-4269-9787-8a8d4a41b8af" returned: 0 in 0.085s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:53 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-ab7b8c9e-b4b9-4fd1-8416-1a5263464b55 tempest-GroupsTest-690885280 None] <== create_volume: return (476ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:49:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ab7b8c9e-b4b9-4fd1-8416-1a5263464b55 tempest-GroupsTest-690885280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.488s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:49:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ab7b8c9e-b4b9-4fd1-8416-1a5263464b55 tempest-GroupsTest-690885280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b383f03e-ee73-467f-af8e-3b253a9021ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6d2f739-2f6c-4269-9787-8a8d4a41b8af', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:49:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ab7b8c9e-b4b9-4fd1-8416-1a5263464b55 tempest-GroupsTest-690885280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61d7375c-8299-4b35-bda5-78787a87687e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:49:53 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-ab7b8c9e-b4b9-4fd1-8416-1a5263464b55 tempest-GroupsTest-690885280 None] Volume volume-b6d2f739-2f6c-4269-9787-8a8d4a41b8af (b6d2f739-2f6c-4269-9787-8a8d4a41b8af): created successfully
Sep 18 11:49:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ab7b8c9e-b4b9-4fd1-8416-1a5263464b55 tempest-GroupsTest-690885280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61d7375c-8299-4b35-bda5-78787a87687e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:49:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ab7b8c9e-b4b9-4fd1-8416-1a5263464b55 tempest-GroupsTest-690885280 None] Flow 'volume_create_manager' (139e8f49-a45e-4ff7-9ae4-e69b9b296dc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:49:53 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-ab7b8c9e-b4b9-4fd1-8416-1a5263464b55 tempest-GroupsTest-690885280 None] Created volume successfully.
Sep 18 11:49:54 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-ac0381b9-98ba-4c3a-8f99-a66b8f4360e6 tempest-GroupsTest-690885280 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:49:54 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac0381b9-98ba-4c3a-8f99-a66b8f4360e6 tempest-GroupsTest-690885280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:49:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ac0381b9-98ba-4c3a-8f99-a66b8f4360e6 tempest-GroupsTest-690885280 None] Flow 'volume_create_manager' (bc953711-e64c-47c4-b61c-84ce905af5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:49:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ac0381b9-98ba-4c3a-8f99-a66b8f4360e6 tempest-GroupsTest-690885280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f39cc663-f740-4a32-94a5-f2bedb45c2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:49:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ac0381b9-98ba-4c3a-8f99-a66b8f4360e6 tempest-GroupsTest-690885280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f39cc663-f740-4a32-94a5-f2bedb45c2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:49:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1974591240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7d97cf43-489d-42fc-99e3-c1192bc136c1,host='devstack@QuobyteHD#QuobyteHD',id=189b5ec2-a7d9-4980-afe6-eeeba831588c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9b046db647b406ea4d07f70cba7b000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:49:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:49:55Z,use_quota=True,user_id='d300da98006c44ccad613eb7861496cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7efbbad4-b4d5-4101-a135-74e2ddc45b59),volume_type_id=7efbbad4-b4d5-4101-a135-74e2ddc45b59)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:49:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ac0381b9-98ba-4c3a-8f99-a66b8f4360e6 tempest-GroupsTest-690885280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04af016b-c232-42a3-82d9-da3faf3ecbba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:49:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ac0381b9-98ba-4c3a-8f99-a66b8f4360e6 tempest-GroupsTest-690885280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04af016b-c232-42a3-82d9-da3faf3ecbba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:49:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ac0381b9-98ba-4c3a-8f99-a66b8f4360e6 tempest-GroupsTest-690885280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ede3529-c18f-4a69-80b7-066df948bb6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:49:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ac0381b9-98ba-4c3a-8f99-a66b8f4360e6 tempest-GroupsTest-690885280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ede3529-c18f-4a69-80b7-066df948bb6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '189b5ec2-a7d9-4980-afe6-eeeba831588c', 'volume_name': 'volume-189b5ec2-a7d9-4980-afe6-eeeba831588c', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:49:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ac0381b9-98ba-4c3a-8f99-a66b8f4360e6 tempest-GroupsTest-690885280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1136fb0-2327-482b-bb5c-3ee8ef15402d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:49:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ac0381b9-98ba-4c3a-8f99-a66b8f4360e6 tempest-GroupsTest-690885280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1136fb0-2327-482b-bb5c-3ee8ef15402d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:49:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ac0381b9-98ba-4c3a-8f99-a66b8f4360e6 tempest-GroupsTest-690885280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b3382e2-d56d-48a8-81cc-174d5e8c5dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:49:54 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-ac0381b9-98ba-4c3a-8f99-a66b8f4360e6 tempest-GroupsTest-690885280 None] Volume 189b5ec2-a7d9-4980-afe6-eeeba831588c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-189b5ec2-a7d9-4980-afe6-eeeba831588c', 'volume_size': 1}
Sep 18 11:49:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ac0381b9-98ba-4c3a-8f99-a66b8f4360e6 tempest-GroupsTest-690885280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:49:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ac0381b9-98ba-4c3a-8f99-a66b8f4360e6 tempest-GroupsTest-690885280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:49:54 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-ac0381b9-98ba-4c3a-8f99-a66b8f4360e6 tempest-GroupsTest-690885280 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7d97cf43-489d-42fc-99e3-c1192bc136c1,created_at=2025-09-18T09:49:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1974591240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7d97cf43-489d-42fc-99e3-c1192bc136c1,host='devstack@QuobyteHD#QuobyteHD',id=189b5ec2-a7d9-4980-afe6-eeeba831588c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9b046db647b406ea4d07f70cba7b000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:49:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:49:55Z,use_quota=True,user_id='d300da98006c44ccad613eb7861496cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7efbbad4-b4d5-4101-a135-74e2ddc45b59),volume_type_id=7efbbad4-b4d5-4101-a135-74e2ddc45b59)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:49:54 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-ac0381b9-98ba-4c3a-8f99-a66b8f4360e6 tempest-GroupsTest-690885280 None] Creating volume 189b5ec2-a7d9-4980-afe6-eeeba831588c {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:49:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ac0381b9-98ba-4c3a-8f99-a66b8f4360e6 tempest-GroupsTest-690885280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:49:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ac0381b9-98ba-4c3a-8f99-a66b8f4360e6 tempest-GroupsTest-690885280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:49:54 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-ac0381b9-98ba-4c3a-8f99-a66b8f4360e6 tempest-GroupsTest-690885280 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:49:54 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-ac0381b9-98ba-4c3a-8f99-a66b8f4360e6 tempest-GroupsTest-690885280 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:49:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ac0381b9-98ba-4c3a-8f99-a66b8f4360e6 tempest-GroupsTest-690885280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:49:54 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-ac0381b9-98ba-4c3a-8f99-a66b8f4360e6 tempest-GroupsTest-690885280 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:49:54 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-ac0381b9-98ba-4c3a-8f99-a66b8f4360e6 tempest-GroupsTest-690885280 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:49:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ac0381b9-98ba-4c3a-8f99-a66b8f4360e6 tempest-GroupsTest-690885280 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-189b5ec2-a7d9-4980-afe6-eeeba831588c 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:55 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=75, name=volume-189b5ec2-a7d9-4980-afe6-eeeba831588c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:49:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ac0381b9-98ba-4c3a-8f99-a66b8f4360e6 tempest-GroupsTest-690885280 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-189b5ec2-a7d9-4980-afe6-eeeba831588c 1073741824" returned: 0 in 0.367s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ac0381b9-98ba-4c3a-8f99-a66b8f4360e6 tempest-GroupsTest-690885280 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-189b5ec2-a7d9-4980-afe6-eeeba831588c {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:49:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ac0381b9-98ba-4c3a-8f99-a66b8f4360e6 tempest-GroupsTest-690885280 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-189b5ec2-a7d9-4980-afe6-eeeba831588c" returned: 0 in 0.102s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:49:55 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-ac0381b9-98ba-4c3a-8f99-a66b8f4360e6 tempest-GroupsTest-690885280 None] <== create_volume: return (536ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:49:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ac0381b9-98ba-4c3a-8f99-a66b8f4360e6 tempest-GroupsTest-690885280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.551s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:49:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ac0381b9-98ba-4c3a-8f99-a66b8f4360e6 tempest-GroupsTest-690885280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b3382e2-d56d-48a8-81cc-174d5e8c5dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-189b5ec2-a7d9-4980-afe6-eeeba831588c', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:49:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ac0381b9-98ba-4c3a-8f99-a66b8f4360e6 tempest-GroupsTest-690885280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a32d572-1148-47b3-9c9d-75d9e1af9b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:49:55 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-ac0381b9-98ba-4c3a-8f99-a66b8f4360e6 tempest-GroupsTest-690885280 None] Volume volume-189b5ec2-a7d9-4980-afe6-eeeba831588c (189b5ec2-a7d9-4980-afe6-eeeba831588c): created successfully
Sep 18 11:49:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ac0381b9-98ba-4c3a-8f99-a66b8f4360e6 tempest-GroupsTest-690885280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a32d572-1148-47b3-9c9d-75d9e1af9b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:49:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ac0381b9-98ba-4c3a-8f99-a66b8f4360e6 tempest-GroupsTest-690885280 None] Flow 'volume_create_manager' (bc953711-e64c-47c4-b61c-84ce905af5ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:49:55 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-ac0381b9-98ba-4c3a-8f99-a66b8f4360e6 tempest-GroupsTest-690885280 None] Created volume successfully.
Sep 18 11:49:57 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-7df9a922-c0cf-4ba1-9117-f22a2c60500d tempest-GroupsTest-690885280 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:49:57 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-7df9a922-c0cf-4ba1-9117-f22a2c60500d tempest-GroupsTest-690885280 None] Update group completed successfully.
Sep 18 11:49:58 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-1b540451-4794-478d-80c2-f2d79c117879 tempest-GroupsTest-690885280 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:49:58 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-1b540451-4794-478d-80c2-f2d79c117879 tempest-GroupsTest-690885280 None] Update group completed successfully.
Sep 18 11:50:00 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-4be901db-27ad-4850-a2eb-3560768ea6e2 tempest-GroupsTest-690885280 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:50:00 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4be901db-27ad-4850-a2eb-3560768ea6e2 tempest-GroupsTest-690885280 None] Acquiring lock "cinder-quobyte-189b5ec2-a7d9-4980-afe6-eeeba831588c" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:50:00 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4be901db-27ad-4850-a2eb-3560768ea6e2 tempest-GroupsTest-690885280 None] Lock "cinder-quobyte-189b5ec2-a7d9-4980-afe6-eeeba831588c" acquired by "delete_volume" :: waited 0.051s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:50:00 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa5fec8-27d6-4d28-a4fd-2e786afe85b6]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:50:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4be901db-27ad-4850-a2eb-3560768ea6e2 tempest-GroupsTest-690885280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-189b5ec2-a7d9-4980-afe6-eeeba831588c {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4be901db-27ad-4850-a2eb-3560768ea6e2 tempest-GroupsTest-690885280 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-189b5ec2-a7d9-4980-afe6-eeeba831588c" returned: 0 in 0.432s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4be901db-27ad-4850-a2eb-3560768ea6e2 tempest-GroupsTest-690885280 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-189b5ec2-a7d9-4980-afe6-eeeba831588c {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4be901db-27ad-4850-a2eb-3560768ea6e2 tempest-GroupsTest-690885280 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-189b5ec2-a7d9-4980-afe6-eeeba831588c" returned: 0 in 0.167s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:00 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4be901db-27ad-4850-a2eb-3560768ea6e2 tempest-GroupsTest-690885280 None] Lock "cinder-quobyte-189b5ec2-a7d9-4980-afe6-eeeba831588c" released by "delete_volume" :: held 0.787s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:50:00 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4be901db-27ad-4850-a2eb-3560768ea6e2 tempest-GroupsTest-690885280 None] Acquiring lock "cinder-quobyte-b6d2f739-2f6c-4269-9787-8a8d4a41b8af" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:50:00 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4be901db-27ad-4850-a2eb-3560768ea6e2 tempest-GroupsTest-690885280 None] Lock "cinder-quobyte-b6d2f739-2f6c-4269-9787-8a8d4a41b8af" acquired by "delete_volume" :: waited 0.032s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:50:00 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c824a429-8c04-4c93-b276-83dfd89da6a7]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:50:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4be901db-27ad-4850-a2eb-3560768ea6e2 tempest-GroupsTest-690885280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b6d2f739-2f6c-4269-9787-8a8d4a41b8af {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4be901db-27ad-4850-a2eb-3560768ea6e2 tempest-GroupsTest-690885280 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b6d2f739-2f6c-4269-9787-8a8d4a41b8af" returned: 0 in 0.481s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4be901db-27ad-4850-a2eb-3560768ea6e2 tempest-GroupsTest-690885280 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b6d2f739-2f6c-4269-9787-8a8d4a41b8af {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4be901db-27ad-4850-a2eb-3560768ea6e2 tempest-GroupsTest-690885280 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b6d2f739-2f6c-4269-9787-8a8d4a41b8af" returned: 0 in 0.095s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:01 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4be901db-27ad-4850-a2eb-3560768ea6e2 tempest-GroupsTest-690885280 None] Lock "cinder-quobyte-b6d2f739-2f6c-4269-9787-8a8d4a41b8af" released by "delete_volume" :: held 0.734s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:50:02 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-4be901db-27ad-4850-a2eb-3560768ea6e2 tempest-GroupsTest-690885280 None] Created reservations ['169cfba8-73d6-43af-bf53-e5bf02594b21'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:50:02 devstack cinder-volume[83176]: WARNING cinder.quota [None req-4be901db-27ad-4850-a2eb-3560768ea6e2 tempest-GroupsTest-690885280 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-789934437 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-789934437, it is now deprecated. Please use the default quota class for default quota.
Sep 18 11:50:02 devstack cinder-volume[83176]: WARNING cinder.quota [None req-4be901db-27ad-4850-a2eb-3560768ea6e2 tempest-GroupsTest-690885280 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-789934437 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-789934437, it is now deprecated. Please use the default quota class for default quota.
Sep 18 11:50:02 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-4be901db-27ad-4850-a2eb-3560768ea6e2 tempest-GroupsTest-690885280 None] Created reservations ['2ab2d1f7-ed63-4d1b-9fa9-d34107852a67', 'e8264f50-1dac-4d76-9bca-720038d9033a', '2448d502-c4d2-4552-8e44-be6cb9b17ccc', 'd6662533-e55b-450b-a4ef-312b74be8c21'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:50:02 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-4be901db-27ad-4850-a2eb-3560768ea6e2 tempest-GroupsTest-690885280 None] Created reservations ['feaed71f-c069-4785-bca7-57feb1d41cc8', 'c20c9105-a4f3-4ba9-a5fc-2404fcb25c0d', '7422a285-0853-432b-948e-e8679a0c551a', 'd7bbecac-965d-4af8-9e47-31e461e67013'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:50:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4be901db-27ad-4850-a2eb-3560768ea6e2 tempest-GroupsTest-690885280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:50:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4be901db-27ad-4850-a2eb-3560768ea6e2 tempest-GroupsTest-690885280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:50:02 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-4be901db-27ad-4850-a2eb-3560768ea6e2 tempest-GroupsTest-690885280 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:50:02 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-4be901db-27ad-4850-a2eb-3560768ea6e2 tempest-GroupsTest-690885280 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:50:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4be901db-27ad-4850-a2eb-3560768ea6e2 tempest-GroupsTest-690885280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:50:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4be901db-27ad-4850-a2eb-3560768ea6e2 tempest-GroupsTest-690885280 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4be901db-27ad-4850-a2eb-3560768ea6e2 tempest-GroupsTest-690885280 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.111s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:02 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-4be901db-27ad-4850-a2eb-3560768ea6e2 tempest-GroupsTest-690885280 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:50:02 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-4be901db-27ad-4850-a2eb-3560768ea6e2 tempest-GroupsTest-690885280 None] Delete group completed successfully.
Sep 18 11:50:04 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ef76cef6-2d30-40e6-bf9f-053eef2db256 tempest-AttachVolumeShelveTestJSON-1847875693 None] Acquiring lock "cinder-d09717b4-adeb-48ad-bdd3-9f8e9eafef74-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:50:04 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ef76cef6-2d30-40e6-bf9f-053eef2db256 tempest-AttachVolumeShelveTestJSON-1847875693 None] Lock "cinder-d09717b4-adeb-48ad-bdd3-9f8e9eafef74-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:50:05 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-ef76cef6-2d30-40e6-bf9f-053eef2db256 tempest-AttachVolumeShelveTestJSON-1847875693 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:50:05 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ef76cef6-2d30-40e6-bf9f-053eef2db256 tempest-AttachVolumeShelveTestJSON-1847875693 None] Acquiring lock "cinder-quobyte-d09717b4-adeb-48ad-bdd3-9f8e9eafef74" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:50:05 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ef76cef6-2d30-40e6-bf9f-053eef2db256 tempest-AttachVolumeShelveTestJSON-1847875693 None] Lock "cinder-quobyte-d09717b4-adeb-48ad-bdd3-9f8e9eafef74" acquired by "delete_volume" :: waited 0.016s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:50:05 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[36dc96a2-9d8e-4c90-acc9-e02dc6d57e50]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:50:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ef76cef6-2d30-40e6-bf9f-053eef2db256 tempest-AttachVolumeShelveTestJSON-1847875693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d09717b4-adeb-48ad-bdd3-9f8e9eafef74 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ef76cef6-2d30-40e6-bf9f-053eef2db256 tempest-AttachVolumeShelveTestJSON-1847875693 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d09717b4-adeb-48ad-bdd3-9f8e9eafef74" returned: 0 in 0.531s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ef76cef6-2d30-40e6-bf9f-053eef2db256 tempest-AttachVolumeShelveTestJSON-1847875693 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d09717b4-adeb-48ad-bdd3-9f8e9eafef74 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ef76cef6-2d30-40e6-bf9f-053eef2db256 tempest-AttachVolumeShelveTestJSON-1847875693 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d09717b4-adeb-48ad-bdd3-9f8e9eafef74" returned: 0 in 0.119s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:05 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ef76cef6-2d30-40e6-bf9f-053eef2db256 tempest-AttachVolumeShelveTestJSON-1847875693 None] Lock "cinder-quobyte-d09717b4-adeb-48ad-bdd3-9f8e9eafef74" released by "delete_volume" :: held 0.836s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:50:06 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-ef76cef6-2d30-40e6-bf9f-053eef2db256 tempest-AttachVolumeShelveTestJSON-1847875693 None] Created reservations ['8114420c-e5bb-4abd-b127-de42365edb30', '9daaae64-4509-4538-9659-7f1f5adff233', '020e8ca4-f1bc-40c0-9563-23f7071d2e73', 'c074195a-69b8-4fce-a3f8-a936081a745b'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:50:06 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ef76cef6-2d30-40e6-bf9f-053eef2db256 tempest-AttachVolumeShelveTestJSON-1847875693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:50:06 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ef76cef6-2d30-40e6-bf9f-053eef2db256 tempest-AttachVolumeShelveTestJSON-1847875693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:50:06 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-ef76cef6-2d30-40e6-bf9f-053eef2db256 tempest-AttachVolumeShelveTestJSON-1847875693 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:50:06 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-ef76cef6-2d30-40e6-bf9f-053eef2db256 tempest-AttachVolumeShelveTestJSON-1847875693 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:50:06 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ef76cef6-2d30-40e6-bf9f-053eef2db256 tempest-AttachVolumeShelveTestJSON-1847875693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:50:06 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ef76cef6-2d30-40e6-bf9f-053eef2db256 tempest-AttachVolumeShelveTestJSON-1847875693 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:06 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ef76cef6-2d30-40e6-bf9f-053eef2db256 tempest-AttachVolumeShelveTestJSON-1847875693 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.099s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:06 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-ef76cef6-2d30-40e6-bf9f-053eef2db256 tempest-AttachVolumeShelveTestJSON-1847875693 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:50:06 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-ef76cef6-2d30-40e6-bf9f-053eef2db256 tempest-AttachVolumeShelveTestJSON-1847875693 None] Deleted volume successfully.
Sep 18 11:50:06 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ef76cef6-2d30-40e6-bf9f-053eef2db256 tempest-AttachVolumeShelveTestJSON-1847875693 None] Lock "cinder-d09717b4-adeb-48ad-bdd3-9f8e9eafef74-delete_volume" released by "delete_volume" :: held 2.005s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:50:07 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-877bce95-801a-461f-b02b-371562f3c4e5 tempest-AttachVolumeShelveTestJSON-1847875693 None] Acquiring lock "cinder-1298a5e2-b3cd-4867-bc42-f76f9c8d14a1-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:50:07 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-877bce95-801a-461f-b02b-371562f3c4e5 tempest-AttachVolumeShelveTestJSON-1847875693 None] Lock "cinder-1298a5e2-b3cd-4867-bc42-f76f9c8d14a1-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:50:07 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-877bce95-801a-461f-b02b-371562f3c4e5 tempest-AttachVolumeShelveTestJSON-1847875693 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:50:07 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-877bce95-801a-461f-b02b-371562f3c4e5 tempest-AttachVolumeShelveTestJSON-1847875693 None] Acquiring lock "cinder-quobyte-1298a5e2-b3cd-4867-bc42-f76f9c8d14a1" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:50:07 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-877bce95-801a-461f-b02b-371562f3c4e5 tempest-AttachVolumeShelveTestJSON-1847875693 None] Lock "cinder-quobyte-1298a5e2-b3cd-4867-bc42-f76f9c8d14a1" acquired by "delete_volume" :: waited 0.011s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:50:07 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7433acff-1aac-4041-9189-aaead9faea41]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:50:07 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-877bce95-801a-461f-b02b-371562f3c4e5 tempest-AttachVolumeShelveTestJSON-1847875693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1298a5e2-b3cd-4867-bc42-f76f9c8d14a1 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:07 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-877bce95-801a-461f-b02b-371562f3c4e5 tempest-AttachVolumeShelveTestJSON-1847875693 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1298a5e2-b3cd-4867-bc42-f76f9c8d14a1" returned: 0 in 0.450s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:07 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-877bce95-801a-461f-b02b-371562f3c4e5 tempest-AttachVolumeShelveTestJSON-1847875693 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1298a5e2-b3cd-4867-bc42-f76f9c8d14a1 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:07 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-877bce95-801a-461f-b02b-371562f3c4e5 tempest-AttachVolumeShelveTestJSON-1847875693 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1298a5e2-b3cd-4867-bc42-f76f9c8d14a1" returned: 0 in 0.097s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:08 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-877bce95-801a-461f-b02b-371562f3c4e5 tempest-AttachVolumeShelveTestJSON-1847875693 None] Lock "cinder-quobyte-1298a5e2-b3cd-4867-bc42-f76f9c8d14a1" released by "delete_volume" :: held 0.708s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:50:08 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-877bce95-801a-461f-b02b-371562f3c4e5 tempest-AttachVolumeShelveTestJSON-1847875693 None] Created reservations ['61da86c8-3c93-4945-be9f-d462b8ca2257', 'f3cb3062-d5c9-46f9-bfd3-93d5367bee56', '1cb16b59-2e89-4d1c-bef0-031e1b786b1b', 'e889c902-3ae7-47ed-944a-eabade950350'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:50:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-877bce95-801a-461f-b02b-371562f3c4e5 tempest-AttachVolumeShelveTestJSON-1847875693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:50:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-877bce95-801a-461f-b02b-371562f3c4e5 tempest-AttachVolumeShelveTestJSON-1847875693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:50:08 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-877bce95-801a-461f-b02b-371562f3c4e5 tempest-AttachVolumeShelveTestJSON-1847875693 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:50:08 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-877bce95-801a-461f-b02b-371562f3c4e5 tempest-AttachVolumeShelveTestJSON-1847875693 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:50:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-877bce95-801a-461f-b02b-371562f3c4e5 tempest-AttachVolumeShelveTestJSON-1847875693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:50:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-877bce95-801a-461f-b02b-371562f3c4e5 tempest-AttachVolumeShelveTestJSON-1847875693 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-877bce95-801a-461f-b02b-371562f3c4e5 tempest-AttachVolumeShelveTestJSON-1847875693 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.131s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:08 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-877bce95-801a-461f-b02b-371562f3c4e5 tempest-AttachVolumeShelveTestJSON-1847875693 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:50:08 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-877bce95-801a-461f-b02b-371562f3c4e5 tempest-AttachVolumeShelveTestJSON-1847875693 None] Deleted volume successfully.
Sep 18 11:50:09 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-877bce95-801a-461f-b02b-371562f3c4e5 tempest-AttachVolumeShelveTestJSON-1847875693 None] Lock "cinder-1298a5e2-b3cd-4867-bc42-f76f9c8d14a1-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:50:13 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 11:50:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:50:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:50:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:50:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:50:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:50:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.131s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:14 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:50:18 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=48,cinder:UPDATE=61,cinder:DELETE=3,cinder:INSERT=12 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:50:18 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=52,cinder:UPDATE=56,cinder:INSERT=11,cinder:DELETE=2 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:50:20 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-4e65f686-42f0-4600-9aeb-21fe89ca155a tempest-GroupSnapshotsV319Test-1709486463 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:50:20 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-4e65f686-42f0-4600-9aeb-21fe89ca155a tempest-GroupSnapshotsV319Test-1709486463 None] Group tempest-GroupSnapshotsV319Test-Group-513312832: creating
Sep 18 11:50:20 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-4e65f686-42f0-4600-9aeb-21fe89ca155a tempest-GroupSnapshotsV319Test-1709486463 None] Group tempest-GroupSnapshotsV319Test-Group-513312832: created successfully
Sep 18 11:50:20 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-4e65f686-42f0-4600-9aeb-21fe89ca155a tempest-GroupSnapshotsV319Test-1709486463 None] Create group completed successfully.
Sep 18 11:50:22 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-85710dd3-b4bd-4ab2-af5b-c3aae6ed1586 tempest-GroupSnapshotsV319Test-1709486463 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:50:22 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-85710dd3-b4bd-4ab2-af5b-c3aae6ed1586 tempest-GroupSnapshotsV319Test-1709486463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:50:22 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-85710dd3-b4bd-4ab2-af5b-c3aae6ed1586 tempest-GroupSnapshotsV319Test-1709486463 None] Flow 'volume_create_manager' (ba03c9ac-6d46-4ee9-8e52-d0cc15f70e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:50:22 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-85710dd3-b4bd-4ab2-af5b-c3aae6ed1586 tempest-GroupSnapshotsV319Test-1709486463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50be5dee-95f2-4773-9bcd-0965cad9768c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:50:22 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-85710dd3-b4bd-4ab2-af5b-c3aae6ed1586 tempest-GroupSnapshotsV319Test-1709486463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50be5dee-95f2-4773-9bcd-0965cad9768c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2117144297',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1a27b6ac-fd3b-49eb-9735-f6191e9fda2d,host='devstack@QuobyteHD#QuobyteHD',id=2512e90e-2e85-4b0e-b923-f441af640e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba2d52925464467ca7156a8001678bad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:50:22Z,use_quota=True,user_id='8a0bd00a04b14ab98da5c769c357fbc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ce7ba6b-0c92-4a1a-8242-237f22014311),volume_type_id=8ce7ba6b-0c92-4a1a-8242-237f22014311)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:50:22 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-85710dd3-b4bd-4ab2-af5b-c3aae6ed1586 tempest-GroupSnapshotsV319Test-1709486463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fe95aa3-349b-4b74-af08-e7e7b1016c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:50:22 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-85710dd3-b4bd-4ab2-af5b-c3aae6ed1586 tempest-GroupSnapshotsV319Test-1709486463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fe95aa3-349b-4b74-af08-e7e7b1016c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:50:22 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-85710dd3-b4bd-4ab2-af5b-c3aae6ed1586 tempest-GroupSnapshotsV319Test-1709486463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f00be37b-3343-4f3f-a7d3-ebe6d24c8cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:50:22 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-85710dd3-b4bd-4ab2-af5b-c3aae6ed1586 tempest-GroupSnapshotsV319Test-1709486463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f00be37b-3343-4f3f-a7d3-ebe6d24c8cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2512e90e-2e85-4b0e-b923-f441af640e66', 'volume_name': 'volume-2512e90e-2e85-4b0e-b923-f441af640e66', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:50:22 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-85710dd3-b4bd-4ab2-af5b-c3aae6ed1586 tempest-GroupSnapshotsV319Test-1709486463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc420ce8-8475-47d7-a505-d3e46b6cb058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:50:22 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-85710dd3-b4bd-4ab2-af5b-c3aae6ed1586 tempest-GroupSnapshotsV319Test-1709486463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc420ce8-8475-47d7-a505-d3e46b6cb058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:50:22 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-85710dd3-b4bd-4ab2-af5b-c3aae6ed1586 tempest-GroupSnapshotsV319Test-1709486463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6eaa173-3757-4f5a-886d-ed1180d6644a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:50:22 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-85710dd3-b4bd-4ab2-af5b-c3aae6ed1586 tempest-GroupSnapshotsV319Test-1709486463 None] Volume 2512e90e-2e85-4b0e-b923-f441af640e66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2512e90e-2e85-4b0e-b923-f441af640e66', 'volume_size': 1}
Sep 18 11:50:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-85710dd3-b4bd-4ab2-af5b-c3aae6ed1586 tempest-GroupSnapshotsV319Test-1709486463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:50:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-85710dd3-b4bd-4ab2-af5b-c3aae6ed1586 tempest-GroupSnapshotsV319Test-1709486463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:50:22 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-85710dd3-b4bd-4ab2-af5b-c3aae6ed1586 tempest-GroupSnapshotsV319Test-1709486463 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=1a27b6ac-fd3b-49eb-9735-f6191e9fda2d,created_at=2025-09-18T09:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2117144297',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1a27b6ac-fd3b-49eb-9735-f6191e9fda2d,host='devstack@QuobyteHD#QuobyteHD',id=2512e90e-2e85-4b0e-b923-f441af640e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba2d52925464467ca7156a8001678bad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:50:22Z,use_quota=True,user_id='8a0bd00a04b14ab98da5c769c357fbc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ce7ba6b-0c92-4a1a-8242-237f22014311),volume_type_id=8ce7ba6b-0c92-4a1a-8242-237f22014311)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:50:22 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-85710dd3-b4bd-4ab2-af5b-c3aae6ed1586 tempest-GroupSnapshotsV319Test-1709486463 None] Creating volume 2512e90e-2e85-4b0e-b923-f441af640e66 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:50:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-85710dd3-b4bd-4ab2-af5b-c3aae6ed1586 tempest-GroupSnapshotsV319Test-1709486463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:50:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-85710dd3-b4bd-4ab2-af5b-c3aae6ed1586 tempest-GroupSnapshotsV319Test-1709486463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:50:22 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-85710dd3-b4bd-4ab2-af5b-c3aae6ed1586 tempest-GroupSnapshotsV319Test-1709486463 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:50:22 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-85710dd3-b4bd-4ab2-af5b-c3aae6ed1586 tempest-GroupSnapshotsV319Test-1709486463 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:50:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-85710dd3-b4bd-4ab2-af5b-c3aae6ed1586 tempest-GroupSnapshotsV319Test-1709486463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:50:22 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-85710dd3-b4bd-4ab2-af5b-c3aae6ed1586 tempest-GroupSnapshotsV319Test-1709486463 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:50:22 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-85710dd3-b4bd-4ab2-af5b-c3aae6ed1586 tempest-GroupSnapshotsV319Test-1709486463 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:50:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-85710dd3-b4bd-4ab2-af5b-c3aae6ed1586 tempest-GroupSnapshotsV319Test-1709486463 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2512e90e-2e85-4b0e-b923-f441af640e66 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:22 devstack quobyte-client[83193]: System call of process 94255 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:50:22 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=76, name=volume-2512e90e-2e85-4b0e-b923-f441af640e66, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:50:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-85710dd3-b4bd-4ab2-af5b-c3aae6ed1586 tempest-GroupSnapshotsV319Test-1709486463 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2512e90e-2e85-4b0e-b923-f441af640e66 1073741824" returned: 0 in 0.412s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-85710dd3-b4bd-4ab2-af5b-c3aae6ed1586 tempest-GroupSnapshotsV319Test-1709486463 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2512e90e-2e85-4b0e-b923-f441af640e66 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-85710dd3-b4bd-4ab2-af5b-c3aae6ed1586 tempest-GroupSnapshotsV319Test-1709486463 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2512e90e-2e85-4b0e-b923-f441af640e66" returned: 0 in 0.095s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:22 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-85710dd3-b4bd-4ab2-af5b-c3aae6ed1586 tempest-GroupSnapshotsV319Test-1709486463 None] <== create_volume: return (584ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:50:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-85710dd3-b4bd-4ab2-af5b-c3aae6ed1586 tempest-GroupSnapshotsV319Test-1709486463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.597s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:50:23 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-85710dd3-b4bd-4ab2-af5b-c3aae6ed1586 tempest-GroupSnapshotsV319Test-1709486463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6eaa173-3757-4f5a-886d-ed1180d6644a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2512e90e-2e85-4b0e-b923-f441af640e66', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:50:23 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-85710dd3-b4bd-4ab2-af5b-c3aae6ed1586 tempest-GroupSnapshotsV319Test-1709486463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc6e018d-2edb-4509-9c7f-5b0de949a787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:50:23 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-85710dd3-b4bd-4ab2-af5b-c3aae6ed1586 tempest-GroupSnapshotsV319Test-1709486463 None] Volume volume-2512e90e-2e85-4b0e-b923-f441af640e66 (2512e90e-2e85-4b0e-b923-f441af640e66): created successfully
Sep 18 11:50:23 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-85710dd3-b4bd-4ab2-af5b-c3aae6ed1586 tempest-GroupSnapshotsV319Test-1709486463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc6e018d-2edb-4509-9c7f-5b0de949a787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:50:23 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-85710dd3-b4bd-4ab2-af5b-c3aae6ed1586 tempest-GroupSnapshotsV319Test-1709486463 None] Flow 'volume_create_manager' (ba03c9ac-6d46-4ee9-8e52-d0cc15f70e1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:50:23 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-85710dd3-b4bd-4ab2-af5b-c3aae6ed1586 tempest-GroupSnapshotsV319Test-1709486463 None] Created volume successfully.
Sep 18 11:50:24 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-89dfafc7-53bd-4a04-b15a-3ec441a76843 tempest-GroupSnapshotsV319Test-1709486463 None] GroupSnapshot a7f69f0e-9c96-4dd5-9e5b-582257d3be23: creating.
Sep 18 11:50:24 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-89dfafc7-53bd-4a04-b15a-3ec441a76843 tempest-GroupSnapshotsV319Test-1709486463 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:50:24 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-89dfafc7-53bd-4a04-b15a-3ec441a76843 tempest-GroupSnapshotsV319Test-1709486463 None] Group snapshot a7f69f0e-9c96-4dd5-9e5b-582257d3be23: creating. {{(pid=83176) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 18 11:50:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-89dfafc7-53bd-4a04-b15a-3ec441a76843 tempest-GroupSnapshotsV319Test-1709486463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:50:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-89dfafc7-53bd-4a04-b15a-3ec441a76843 tempest-GroupSnapshotsV319Test-1709486463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:50:24 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-89dfafc7-53bd-4a04-b15a-3ec441a76843 tempest-GroupSnapshotsV319Test-1709486463 None] Creating offline snapshot 59515743-3097-4aa2-8382-3e3318425fad of volume 2512e90e-2e85-4b0e-b923-f441af640e66 {{(pid=83176) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 11:50:24 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[24caab68-d3ca-4404-90ca-420415720385]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:50:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-89dfafc7-53bd-4a04-b15a-3ec441a76843 tempest-GroupSnapshotsV319Test-1709486463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2512e90e-2e85-4b0e-b923-f441af640e66 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-89dfafc7-53bd-4a04-b15a-3ec441a76843 tempest-GroupSnapshotsV319Test-1709486463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2512e90e-2e85-4b0e-b923-f441af640e66" returned: 0 in 0.478s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-89dfafc7-53bd-4a04-b15a-3ec441a76843 tempest-GroupSnapshotsV319Test-1709486463 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2512e90e-2e85-4b0e-b923-f441af640e66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2512e90e-2e85-4b0e-b923-f441af640e66.59515743-3097-4aa2-8382-3e3318425fad 1G {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:25 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=77, name=volume-2512e90e-2e85-4b0e-b923-f441af640e66.59515743-3097-4aa2-8382-3e3318425fad, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:50:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-89dfafc7-53bd-4a04-b15a-3ec441a76843 tempest-GroupSnapshotsV319Test-1709486463 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2512e90e-2e85-4b0e-b923-f441af640e66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2512e90e-2e85-4b0e-b923-f441af640e66.59515743-3097-4aa2-8382-3e3318425fad 1G" returned: 0 in 0.284s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-89dfafc7-53bd-4a04-b15a-3ec441a76843 tempest-GroupSnapshotsV319Test-1709486463 None] Running cmd (subprocess): qemu-img rebase -u -b volume-2512e90e-2e85-4b0e-b923-f441af640e66 -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2512e90e-2e85-4b0e-b923-f441af640e66.59515743-3097-4aa2-8382-3e3318425fad {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:25 devstack quobyte-client[83193]: System call of process 94266 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:50:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-89dfafc7-53bd-4a04-b15a-3ec441a76843 tempest-GroupSnapshotsV319Test-1709486463 None] CMD "qemu-img rebase -u -b volume-2512e90e-2e85-4b0e-b923-f441af640e66 -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2512e90e-2e85-4b0e-b923-f441af640e66.59515743-3097-4aa2-8382-3e3318425fad" returned: 0 in 0.190s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:25 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-89dfafc7-53bd-4a04-b15a-3ec441a76843 tempest-GroupSnapshotsV319Test-1709486463 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2512e90e-2e85-4b0e-b923-f441af640e66.59515743-3097-4aa2-8382-3e3318425fad is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 11:50:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-89dfafc7-53bd-4a04-b15a-3ec441a76843 tempest-GroupSnapshotsV319Test-1709486463 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2512e90e-2e85-4b0e-b923-f441af640e66.59515743-3097-4aa2-8382-3e3318425fad {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-89dfafc7-53bd-4a04-b15a-3ec441a76843 tempest-GroupSnapshotsV319Test-1709486463 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2512e90e-2e85-4b0e-b923-f441af640e66.59515743-3097-4aa2-8382-3e3318425fad" returned: 0 in 0.126s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:26 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-89dfafc7-53bd-4a04-b15a-3ec441a76843 tempest-GroupSnapshotsV319Test-1709486463 None] Setting permissions: /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2512e90e-2e85-4b0e-b923-f441af640e66 -> 1000:1000 {{(pid=83176) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 11:50:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-89dfafc7-53bd-4a04-b15a-3ec441a76843 tempest-GroupSnapshotsV319Test-1709486463 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2512e90e-2e85-4b0e-b923-f441af640e66 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2512e90e-2e85-4b0e-b923-f441af640e66.59515743-3097-4aa2-8382-3e3318425fad {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-89dfafc7-53bd-4a04-b15a-3ec441a76843 tempest-GroupSnapshotsV319Test-1709486463 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2512e90e-2e85-4b0e-b923-f441af640e66 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2512e90e-2e85-4b0e-b923-f441af640e66.59515743-3097-4aa2-8382-3e3318425fad" returned: 0 in 0.140s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-89dfafc7-53bd-4a04-b15a-3ec441a76843 tempest-GroupSnapshotsV319Test-1709486463 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2512e90e-2e85-4b0e-b923-f441af640e66.info {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-89dfafc7-53bd-4a04-b15a-3ec441a76843 tempest-GroupSnapshotsV319Test-1709486463 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2512e90e-2e85-4b0e-b923-f441af640e66.info" returned: 0 in 0.107s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:26 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-89dfafc7-53bd-4a04-b15a-3ec441a76843 tempest-GroupSnapshotsV319Test-1709486463 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2512e90e-2e85-4b0e-b923-f441af640e66.info is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 11:50:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-89dfafc7-53bd-4a04-b15a-3ec441a76843 tempest-GroupSnapshotsV319Test-1709486463 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2512e90e-2e85-4b0e-b923-f441af640e66.info {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-89dfafc7-53bd-4a04-b15a-3ec441a76843 tempest-GroupSnapshotsV319Test-1709486463 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2512e90e-2e85-4b0e-b923-f441af640e66.info" returned: 0 in 0.095s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-89dfafc7-53bd-4a04-b15a-3ec441a76843 tempest-GroupSnapshotsV319Test-1709486463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.742s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:50:26 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-89dfafc7-53bd-4a04-b15a-3ec441a76843 tempest-GroupSnapshotsV319Test-1709486463 None] group_snapshot a7f69f0e-9c96-4dd5-9e5b-582257d3be23: created successfully
Sep 18 11:50:28 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-ed73b220-b3b6-4d3a-ac12-2e3587f73290 tempest-GroupSnapshotsV319Test-1709486463 None] group_snapshot a7f69f0e-9c96-4dd5-9e5b-582257d3be23: deleting
Sep 18 11:50:28 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-ed73b220-b3b6-4d3a-ac12-2e3587f73290 tempest-GroupSnapshotsV319Test-1709486463 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:50:28 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ed73b220-b3b6-4d3a-ac12-2e3587f73290 tempest-GroupSnapshotsV319Test-1709486463 None] group_snapshot a7f69f0e-9c96-4dd5-9e5b-582257d3be23: deleting {{(pid=83176) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 18 11:50:28 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ed73b220-b3b6-4d3a-ac12-2e3587f73290 tempest-GroupSnapshotsV319Test-1709486463 None] Acquiring lock "cinder-quobyte-2512e90e-2e85-4b0e-b923-f441af640e66" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:50:28 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ed73b220-b3b6-4d3a-ac12-2e3587f73290 tempest-GroupSnapshotsV319Test-1709486463 None] Lock "cinder-quobyte-2512e90e-2e85-4b0e-b923-f441af640e66" acquired by "delete_snapshot" :: waited 0.087s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:50:28 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ed73b220-b3b6-4d3a-ac12-2e3587f73290 tempest-GroupSnapshotsV319Test-1709486463 None] Acquiring lock "cinder-quobyte-59515743-3097-4aa2-8382-3e3318425fad" by "_delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:50:28 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-d1e02286-6e5c-47fd-ba3f-2fc9f3ba52e6 tempest-VolumesServicesTestJSON-251764773 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:50:28 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1e02286-6e5c-47fd-ba3f-2fc9f3ba52e6 tempest-VolumesServicesTestJSON-251764773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:50:28 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d1e02286-6e5c-47fd-ba3f-2fc9f3ba52e6 tempest-VolumesServicesTestJSON-251764773 None] Flow 'volume_create_manager' (504d4fea-2f5a-4841-a797-2e41dab86000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:50:28 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d1e02286-6e5c-47fd-ba3f-2fc9f3ba52e6 tempest-VolumesServicesTestJSON-251764773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7ef574f-a500-4a6e-bd67-de9d30aff895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:50:28 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ed73b220-b3b6-4d3a-ac12-2e3587f73290 tempest-GroupSnapshotsV319Test-1709486463 None] Lock "cinder-quobyte-59515743-3097-4aa2-8382-3e3318425fad" acquired by "_delete_snapshot" :: waited 0.106s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:50:28 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-ed73b220-b3b6-4d3a-ac12-2e3587f73290 tempest-GroupSnapshotsV319Test-1709486463 None] Deleting offline snapshot 59515743-3097-4aa2-8382-3e3318425fad of volume 2512e90e-2e85-4b0e-b923-f441af640e66 {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 11:50:28 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-ed73b220-b3b6-4d3a-ac12-2e3587f73290 tempest-GroupSnapshotsV319Test-1709486463 None] snapshot_file for this snap is: volume-2512e90e-2e85-4b0e-b923-f441af640e66.59515743-3097-4aa2-8382-3e3318425fad {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 11:50:28 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a646c82-1a13-47a7-9b0b-1ca82b18940b]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:50:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ed73b220-b3b6-4d3a-ac12-2e3587f73290 tempest-GroupSnapshotsV319Test-1709486463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2512e90e-2e85-4b0e-b923-f441af640e66.59515743-3097-4aa2-8382-3e3318425fad {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:29 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d1e02286-6e5c-47fd-ba3f-2fc9f3ba52e6 tempest-VolumesServicesTestJSON-251764773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7ef574f-a500-4a6e-bd67-de9d30aff895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-747610117',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a870fde4-6230-4bd8-92a0-579eb76a15a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0b51f2a35424b8db320857e1744b3c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:50:29Z,use_quota=True,user_id='874c5eea4c05401aa2a6d54549256d9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:50:29 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d1e02286-6e5c-47fd-ba3f-2fc9f3ba52e6 tempest-VolumesServicesTestJSON-251764773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02f69ea1-ab66-489a-a3aa-0922ae324006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:50:29 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d1e02286-6e5c-47fd-ba3f-2fc9f3ba52e6 tempest-VolumesServicesTestJSON-251764773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02f69ea1-ab66-489a-a3aa-0922ae324006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:50:29 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d1e02286-6e5c-47fd-ba3f-2fc9f3ba52e6 tempest-VolumesServicesTestJSON-251764773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (355d5818-95d5-4ec0-98d8-2301332c9367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:50:29 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d1e02286-6e5c-47fd-ba3f-2fc9f3ba52e6 tempest-VolumesServicesTestJSON-251764773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (355d5818-95d5-4ec0-98d8-2301332c9367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a870fde4-6230-4bd8-92a0-579eb76a15a9', 'volume_name': 'volume-a870fde4-6230-4bd8-92a0-579eb76a15a9', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:50:29 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d1e02286-6e5c-47fd-ba3f-2fc9f3ba52e6 tempest-VolumesServicesTestJSON-251764773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f35ce986-f2b0-48d0-aa6b-6b6e931e28bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:50:29 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d1e02286-6e5c-47fd-ba3f-2fc9f3ba52e6 tempest-VolumesServicesTestJSON-251764773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f35ce986-f2b0-48d0-aa6b-6b6e931e28bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:50:29 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d1e02286-6e5c-47fd-ba3f-2fc9f3ba52e6 tempest-VolumesServicesTestJSON-251764773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aedac81-9fc3-4603-a0fc-c73162003910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:50:29 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-d1e02286-6e5c-47fd-ba3f-2fc9f3ba52e6 tempest-VolumesServicesTestJSON-251764773 None] Volume a870fde4-6230-4bd8-92a0-579eb76a15a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a870fde4-6230-4bd8-92a0-579eb76a15a9', 'volume_size': 1}
Sep 18 11:50:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d1e02286-6e5c-47fd-ba3f-2fc9f3ba52e6 tempest-VolumesServicesTestJSON-251764773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:50:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d1e02286-6e5c-47fd-ba3f-2fc9f3ba52e6 tempest-VolumesServicesTestJSON-251764773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:50:29 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-d1e02286-6e5c-47fd-ba3f-2fc9f3ba52e6 tempest-VolumesServicesTestJSON-251764773 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-747610117',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a870fde4-6230-4bd8-92a0-579eb76a15a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0b51f2a35424b8db320857e1744b3c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:50:29Z,use_quota=True,user_id='874c5eea4c05401aa2a6d54549256d9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:50:29 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-d1e02286-6e5c-47fd-ba3f-2fc9f3ba52e6 tempest-VolumesServicesTestJSON-251764773 None] Creating volume a870fde4-6230-4bd8-92a0-579eb76a15a9 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:50:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d1e02286-6e5c-47fd-ba3f-2fc9f3ba52e6 tempest-VolumesServicesTestJSON-251764773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:50:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d1e02286-6e5c-47fd-ba3f-2fc9f3ba52e6 tempest-VolumesServicesTestJSON-251764773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:50:29 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-d1e02286-6e5c-47fd-ba3f-2fc9f3ba52e6 tempest-VolumesServicesTestJSON-251764773 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:50:29 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-d1e02286-6e5c-47fd-ba3f-2fc9f3ba52e6 tempest-VolumesServicesTestJSON-251764773 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:50:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d1e02286-6e5c-47fd-ba3f-2fc9f3ba52e6 tempest-VolumesServicesTestJSON-251764773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:50:29 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-d1e02286-6e5c-47fd-ba3f-2fc9f3ba52e6 tempest-VolumesServicesTestJSON-251764773 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:50:29 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-d1e02286-6e5c-47fd-ba3f-2fc9f3ba52e6 tempest-VolumesServicesTestJSON-251764773 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:50:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d1e02286-6e5c-47fd-ba3f-2fc9f3ba52e6 tempest-VolumesServicesTestJSON-251764773 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a870fde4-6230-4bd8-92a0-579eb76a15a9 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:29 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=79, name=volume-a870fde4-6230-4bd8-92a0-579eb76a15a9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:50:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ed73b220-b3b6-4d3a-ac12-2e3587f73290 tempest-GroupSnapshotsV319Test-1709486463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2512e90e-2e85-4b0e-b923-f441af640e66.59515743-3097-4aa2-8382-3e3318425fad" returned: 0 in 0.486s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:29 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-ed73b220-b3b6-4d3a-ac12-2e3587f73290 tempest-GroupSnapshotsV319Test-1709486463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2512e90e-2e85-4b0e-b923-f441af640e66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 11:50:29 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c422af9d-899f-4e4d-a497-ba27441218b2]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:50:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ed73b220-b3b6-4d3a-ac12-2e3587f73290 tempest-GroupSnapshotsV319Test-1709486463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2512e90e-2e85-4b0e-b923-f441af640e66 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d1e02286-6e5c-47fd-ba3f-2fc9f3ba52e6 tempest-VolumesServicesTestJSON-251764773 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a870fde4-6230-4bd8-92a0-579eb76a15a9 1073741824" returned: 0 in 0.431s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d1e02286-6e5c-47fd-ba3f-2fc9f3ba52e6 tempest-VolumesServicesTestJSON-251764773 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a870fde4-6230-4bd8-92a0-579eb76a15a9 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d1e02286-6e5c-47fd-ba3f-2fc9f3ba52e6 tempest-VolumesServicesTestJSON-251764773 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a870fde4-6230-4bd8-92a0-579eb76a15a9" returned: 0 in 0.137s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:29 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-d1e02286-6e5c-47fd-ba3f-2fc9f3ba52e6 tempest-VolumesServicesTestJSON-251764773 None] <== create_volume: return (654ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:50:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d1e02286-6e5c-47fd-ba3f-2fc9f3ba52e6 tempest-VolumesServicesTestJSON-251764773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:50:30 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d1e02286-6e5c-47fd-ba3f-2fc9f3ba52e6 tempest-VolumesServicesTestJSON-251764773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aedac81-9fc3-4603-a0fc-c73162003910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a870fde4-6230-4bd8-92a0-579eb76a15a9', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:50:30 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d1e02286-6e5c-47fd-ba3f-2fc9f3ba52e6 tempest-VolumesServicesTestJSON-251764773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15b7a447-fdc7-4be2-a90d-3fcaae72f4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:50:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ed73b220-b3b6-4d3a-ac12-2e3587f73290 tempest-GroupSnapshotsV319Test-1709486463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2512e90e-2e85-4b0e-b923-f441af640e66" returned: 0 in 0.621s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ed73b220-b3b6-4d3a-ac12-2e3587f73290 tempest-GroupSnapshotsV319Test-1709486463 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2512e90e-2e85-4b0e-b923-f441af640e66.59515743-3097-4aa2-8382-3e3318425fad {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:30 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-d1e02286-6e5c-47fd-ba3f-2fc9f3ba52e6 tempest-VolumesServicesTestJSON-251764773 None] Volume volume-a870fde4-6230-4bd8-92a0-579eb76a15a9 (a870fde4-6230-4bd8-92a0-579eb76a15a9): created successfully
Sep 18 11:50:30 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d1e02286-6e5c-47fd-ba3f-2fc9f3ba52e6 tempest-VolumesServicesTestJSON-251764773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15b7a447-fdc7-4be2-a90d-3fcaae72f4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:50:30 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d1e02286-6e5c-47fd-ba3f-2fc9f3ba52e6 tempest-VolumesServicesTestJSON-251764773 None] Flow 'volume_create_manager' (504d4fea-2f5a-4841-a797-2e41dab86000) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:50:30 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-d1e02286-6e5c-47fd-ba3f-2fc9f3ba52e6 tempest-VolumesServicesTestJSON-251764773 None] Created volume successfully.
Sep 18 11:50:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ed73b220-b3b6-4d3a-ac12-2e3587f73290 tempest-GroupSnapshotsV319Test-1709486463 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2512e90e-2e85-4b0e-b923-f441af640e66.59515743-3097-4aa2-8382-3e3318425fad" returned: 0 in 0.373s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ed73b220-b3b6-4d3a-ac12-2e3587f73290 tempest-GroupSnapshotsV319Test-1709486463 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2512e90e-2e85-4b0e-b923-f441af640e66.59515743-3097-4aa2-8382-3e3318425fad {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ed73b220-b3b6-4d3a-ac12-2e3587f73290 tempest-GroupSnapshotsV319Test-1709486463 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2512e90e-2e85-4b0e-b923-f441af640e66.59515743-3097-4aa2-8382-3e3318425fad" returned: 0 in 0.124s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:30 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ed73b220-b3b6-4d3a-ac12-2e3587f73290 tempest-GroupSnapshotsV319Test-1709486463 None] Lock "cinder-quobyte-59515743-3097-4aa2-8382-3e3318425fad" released by "_delete_snapshot" :: held 1.867s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:50:30 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ed73b220-b3b6-4d3a-ac12-2e3587f73290 tempest-GroupSnapshotsV319Test-1709486463 None] Lock "cinder-quobyte-2512e90e-2e85-4b0e-b923-f441af640e66" released by "delete_snapshot" :: held 1.984s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:50:31 devstack cinder-volume[83176]: WARNING cinder.quota [None req-ed73b220-b3b6-4d3a-ac12-2e3587f73290 tempest-GroupSnapshotsV319Test-1709486463 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1333340501 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1333340501, it is now deprecated. Please use the default quota class for default quota.
Sep 18 11:50:31 devstack cinder-volume[83176]: WARNING cinder.quota [None req-ed73b220-b3b6-4d3a-ac12-2e3587f73290 tempest-GroupSnapshotsV319Test-1709486463 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1333340501 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1333340501, it is now deprecated. Please use the default quota class for default quota.
Sep 18 11:50:31 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-ed73b220-b3b6-4d3a-ac12-2e3587f73290 tempest-GroupSnapshotsV319Test-1709486463 None] Created reservations ['26777bd9-5efb-4058-a070-978ad0fe85c2', 'e26e56ec-9f39-48b4-817c-4d0f92337c02', '19f2c939-6520-4144-ac73-ea7b0bd521a3', '2e2abac9-cbb9-4824-898a-bf154ce67863'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:50:31 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-2aa8ed01-ef2d-4e17-8f1a-2e03ec566d20 tempest-VolumesServicesTestJSON-251764773 None] Acquiring lock "cinder-a870fde4-6230-4bd8-92a0-579eb76a15a9-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:50:31 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-ed73b220-b3b6-4d3a-ac12-2e3587f73290 tempest-GroupSnapshotsV319Test-1709486463 None] group_snapshot a7f69f0e-9c96-4dd5-9e5b-582257d3be23: deleted successfully
Sep 18 11:50:31 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-2aa8ed01-ef2d-4e17-8f1a-2e03ec566d20 tempest-VolumesServicesTestJSON-251764773 None] Lock "cinder-a870fde4-6230-4bd8-92a0-579eb76a15a9-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:50:31 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-2aa8ed01-ef2d-4e17-8f1a-2e03ec566d20 tempest-VolumesServicesTestJSON-251764773 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:50:31 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-2aa8ed01-ef2d-4e17-8f1a-2e03ec566d20 tempest-VolumesServicesTestJSON-251764773 None] Acquiring lock "cinder-quobyte-a870fde4-6230-4bd8-92a0-579eb76a15a9" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:50:31 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-2aa8ed01-ef2d-4e17-8f1a-2e03ec566d20 tempest-VolumesServicesTestJSON-251764773 None] Lock "cinder-quobyte-a870fde4-6230-4bd8-92a0-579eb76a15a9" acquired by "delete_volume" :: waited 0.024s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:50:31 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[627d102b-969c-4c95-8804-896124ea2818]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:50:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2aa8ed01-ef2d-4e17-8f1a-2e03ec566d20 tempest-VolumesServicesTestJSON-251764773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a870fde4-6230-4bd8-92a0-579eb76a15a9 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2aa8ed01-ef2d-4e17-8f1a-2e03ec566d20 tempest-VolumesServicesTestJSON-251764773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a870fde4-6230-4bd8-92a0-579eb76a15a9" returned: 0 in 0.409s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2aa8ed01-ef2d-4e17-8f1a-2e03ec566d20 tempest-VolumesServicesTestJSON-251764773 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a870fde4-6230-4bd8-92a0-579eb76a15a9 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2aa8ed01-ef2d-4e17-8f1a-2e03ec566d20 tempest-VolumesServicesTestJSON-251764773 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a870fde4-6230-4bd8-92a0-579eb76a15a9" returned: 0 in 0.123s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:32 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-2aa8ed01-ef2d-4e17-8f1a-2e03ec566d20 tempest-VolumesServicesTestJSON-251764773 None] Lock "cinder-quobyte-a870fde4-6230-4bd8-92a0-579eb76a15a9" released by "delete_volume" :: held 0.707s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:50:32 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-f4d27859-d8d9-4a91-a80b-ab2cb37b300e tempest-GroupSnapshotsV319Test-1709486463 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:50:32 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f4d27859-d8d9-4a91-a80b-ab2cb37b300e tempest-GroupSnapshotsV319Test-1709486463 None] Acquiring lock "cinder-quobyte-2512e90e-2e85-4b0e-b923-f441af640e66" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:50:32 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-2aa8ed01-ef2d-4e17-8f1a-2e03ec566d20 tempest-VolumesServicesTestJSON-251764773 None] Created reservations ['266247c4-3c62-4d31-b6f7-8f2f063b0c2a', '9f3b8d32-9ce0-4c06-9499-3c066ed16c79', 'c4e430d5-0c40-4703-ad2d-e17010882c65', '092351bc-6f61-419e-aa1b-21c7e8984ffd'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:50:32 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f4d27859-d8d9-4a91-a80b-ab2cb37b300e tempest-GroupSnapshotsV319Test-1709486463 None] Lock "cinder-quobyte-2512e90e-2e85-4b0e-b923-f441af640e66" acquired by "delete_volume" :: waited 0.049s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:50:32 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc96013-d85d-43c5-8eb1-68dbdf232d37]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:50:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f4d27859-d8d9-4a91-a80b-ab2cb37b300e tempest-GroupSnapshotsV319Test-1709486463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2512e90e-2e85-4b0e-b923-f441af640e66 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-2aa8ed01-ef2d-4e17-8f1a-2e03ec566d20 tempest-VolumesServicesTestJSON-251764773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:50:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-2aa8ed01-ef2d-4e17-8f1a-2e03ec566d20 tempest-VolumesServicesTestJSON-251764773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:50:32 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-2aa8ed01-ef2d-4e17-8f1a-2e03ec566d20 tempest-VolumesServicesTestJSON-251764773 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:50:32 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-2aa8ed01-ef2d-4e17-8f1a-2e03ec566d20 tempest-VolumesServicesTestJSON-251764773 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:50:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-2aa8ed01-ef2d-4e17-8f1a-2e03ec566d20 tempest-VolumesServicesTestJSON-251764773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:50:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2aa8ed01-ef2d-4e17-8f1a-2e03ec566d20 tempest-VolumesServicesTestJSON-251764773 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2aa8ed01-ef2d-4e17-8f1a-2e03ec566d20 tempest-VolumesServicesTestJSON-251764773 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.108s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:33 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-2aa8ed01-ef2d-4e17-8f1a-2e03ec566d20 tempest-VolumesServicesTestJSON-251764773 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:50:33 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-2aa8ed01-ef2d-4e17-8f1a-2e03ec566d20 tempest-VolumesServicesTestJSON-251764773 None] Deleted volume successfully.
Sep 18 11:50:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f4d27859-d8d9-4a91-a80b-ab2cb37b300e tempest-GroupSnapshotsV319Test-1709486463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2512e90e-2e85-4b0e-b923-f441af640e66" returned: 0 in 0.724s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f4d27859-d8d9-4a91-a80b-ab2cb37b300e tempest-GroupSnapshotsV319Test-1709486463 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2512e90e-2e85-4b0e-b923-f441af640e66 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:33 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-2aa8ed01-ef2d-4e17-8f1a-2e03ec566d20 tempest-VolumesServicesTestJSON-251764773 None] Lock "cinder-a870fde4-6230-4bd8-92a0-579eb76a15a9-delete_volume" released by "delete_volume" :: held 2.150s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:50:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f4d27859-d8d9-4a91-a80b-ab2cb37b300e tempest-GroupSnapshotsV319Test-1709486463 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2512e90e-2e85-4b0e-b923-f441af640e66" returned: 0 in 0.238s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:33 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f4d27859-d8d9-4a91-a80b-ab2cb37b300e tempest-GroupSnapshotsV319Test-1709486463 None] Lock "cinder-quobyte-2512e90e-2e85-4b0e-b923-f441af640e66" released by "delete_volume" :: held 1.050s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:50:33 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-f4d27859-d8d9-4a91-a80b-ab2cb37b300e tempest-GroupSnapshotsV319Test-1709486463 None] Created reservations ['c1ec5ef4-d751-44ef-82ad-3221c199fcc2'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:50:33 devstack cinder-volume[83176]: WARNING cinder.quota [None req-f4d27859-d8d9-4a91-a80b-ab2cb37b300e tempest-GroupSnapshotsV319Test-1709486463 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1333340501 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1333340501, it is now deprecated. Please use the default quota class for default quota.
Sep 18 11:50:33 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-f4d27859-d8d9-4a91-a80b-ab2cb37b300e tempest-GroupSnapshotsV319Test-1709486463 None] Created reservations ['cc2b2eeb-3978-4391-88e7-b3541e0cf597', 'e5b8e764-fe44-4d69-b611-bff254723591', 'e1fe88ad-b8ad-458d-84cf-16b70fe365fb', 'd685f831-7a4d-484c-b754-99a4335560dd'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:50:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f4d27859-d8d9-4a91-a80b-ab2cb37b300e tempest-GroupSnapshotsV319Test-1709486463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:50:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f4d27859-d8d9-4a91-a80b-ab2cb37b300e tempest-GroupSnapshotsV319Test-1709486463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:50:34 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f4d27859-d8d9-4a91-a80b-ab2cb37b300e tempest-GroupSnapshotsV319Test-1709486463 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:50:34 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f4d27859-d8d9-4a91-a80b-ab2cb37b300e tempest-GroupSnapshotsV319Test-1709486463 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:50:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f4d27859-d8d9-4a91-a80b-ab2cb37b300e tempest-GroupSnapshotsV319Test-1709486463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:50:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f4d27859-d8d9-4a91-a80b-ab2cb37b300e tempest-GroupSnapshotsV319Test-1709486463 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f4d27859-d8d9-4a91-a80b-ab2cb37b300e tempest-GroupSnapshotsV319Test-1709486463 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.099s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:34 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-f4d27859-d8d9-4a91-a80b-ab2cb37b300e tempest-GroupSnapshotsV319Test-1709486463 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:50:34 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-f4d27859-d8d9-4a91-a80b-ab2cb37b300e tempest-GroupSnapshotsV319Test-1709486463 None] Delete group completed successfully.
Sep 18 11:50:41 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-3ff58866-29ac-416c-abe5-15d00f6ef780 tempest-GroupsV320Test-73024547 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:50:41 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-3ff58866-29ac-416c-abe5-15d00f6ef780 tempest-GroupsV320Test-73024547 None] Group tempest-GroupsV320Test-Group-102420066: creating
Sep 18 11:50:42 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-3ff58866-29ac-416c-abe5-15d00f6ef780 tempest-GroupsV320Test-73024547 None] Group tempest-GroupsV320Test-Group-102420066: created successfully
Sep 18 11:50:42 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-3ff58866-29ac-416c-abe5-15d00f6ef780 tempest-GroupsV320Test-73024547 None] Create group completed successfully.
Sep 18 11:50:43 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-d5e276e6-c18d-48a2-aeda-7338526aa817 tempest-GroupsV320Test-73024547 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:50:43 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-d5e276e6-c18d-48a2-aeda-7338526aa817 tempest-GroupsV320Test-73024547 None] Created reservations ['ec70f69a-03b7-4cca-9b57-f66e3d513ff9'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:50:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d5e276e6-c18d-48a2-aeda-7338526aa817 tempest-GroupsV320Test-73024547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:50:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d5e276e6-c18d-48a2-aeda-7338526aa817 tempest-GroupsV320Test-73024547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:50:43 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-d5e276e6-c18d-48a2-aeda-7338526aa817 tempest-GroupsV320Test-73024547 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:50:43 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-d5e276e6-c18d-48a2-aeda-7338526aa817 tempest-GroupsV320Test-73024547 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:50:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d5e276e6-c18d-48a2-aeda-7338526aa817 tempest-GroupsV320Test-73024547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:50:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d5e276e6-c18d-48a2-aeda-7338526aa817 tempest-GroupsV320Test-73024547 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d5e276e6-c18d-48a2-aeda-7338526aa817 tempest-GroupsV320Test-73024547 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.137s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:43 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-d5e276e6-c18d-48a2-aeda-7338526aa817 tempest-GroupsV320Test-73024547 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:50:44 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-d5e276e6-c18d-48a2-aeda-7338526aa817 tempest-GroupsV320Test-73024547 None] Delete group completed successfully.
Sep 18 11:50:51 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-c9fb2ad0-045e-416c-afcf-874a9a9f272c tempest-SnapshotsActionsTest-375113023 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:50:51 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9fb2ad0-045e-416c-afcf-874a9a9f272c tempest-SnapshotsActionsTest-375113023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:50:51 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c9fb2ad0-045e-416c-afcf-874a9a9f272c tempest-SnapshotsActionsTest-375113023 None] Flow 'volume_create_manager' (22b79e67-7e89-456d-9216-ae58ee021820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:50:51 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c9fb2ad0-045e-416c-afcf-874a9a9f272c tempest-SnapshotsActionsTest-375113023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bfc6a80-3b23-4fe8-a76b-79b93c63e951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:50:51 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c9fb2ad0-045e-416c-afcf-874a9a9f272c tempest-SnapshotsActionsTest-375113023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bfc6a80-3b23-4fe8-a76b-79b93c63e951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-647080997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=261364e0-a1bd-445a-93cd-88ea053c65cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a005a3e26d94da4a3511d27a6b72c34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:50:51Z,use_quota=True,user_id='58671c73ab8447428bc8977b77d30ea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:50:51 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c9fb2ad0-045e-416c-afcf-874a9a9f272c tempest-SnapshotsActionsTest-375113023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e75987e-847a-4bb6-b136-77a160a73e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:50:51 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c9fb2ad0-045e-416c-afcf-874a9a9f272c tempest-SnapshotsActionsTest-375113023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e75987e-847a-4bb6-b136-77a160a73e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:50:51 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c9fb2ad0-045e-416c-afcf-874a9a9f272c tempest-SnapshotsActionsTest-375113023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd92a0c-9f36-405d-a461-5df74cef24fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:50:51 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c9fb2ad0-045e-416c-afcf-874a9a9f272c tempest-SnapshotsActionsTest-375113023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd92a0c-9f36-405d-a461-5df74cef24fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '261364e0-a1bd-445a-93cd-88ea053c65cb', 'volume_name': 'volume-261364e0-a1bd-445a-93cd-88ea053c65cb', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:50:51 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c9fb2ad0-045e-416c-afcf-874a9a9f272c tempest-SnapshotsActionsTest-375113023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (213095b0-4d51-4ce8-886e-d64be08abad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:50:51 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c9fb2ad0-045e-416c-afcf-874a9a9f272c tempest-SnapshotsActionsTest-375113023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (213095b0-4d51-4ce8-886e-d64be08abad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:50:51 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c9fb2ad0-045e-416c-afcf-874a9a9f272c tempest-SnapshotsActionsTest-375113023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ae3e184-1d85-4854-80d0-37de3d02a7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:50:51 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-c9fb2ad0-045e-416c-afcf-874a9a9f272c tempest-SnapshotsActionsTest-375113023 None] Volume 261364e0-a1bd-445a-93cd-88ea053c65cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-261364e0-a1bd-445a-93cd-88ea053c65cb', 'volume_size': 1}
Sep 18 11:50:51 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-c9fb2ad0-045e-416c-afcf-874a9a9f272c tempest-SnapshotsActionsTest-375113023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:50:51 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-c9fb2ad0-045e-416c-afcf-874a9a9f272c tempest-SnapshotsActionsTest-375113023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:50:51 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-c9fb2ad0-045e-416c-afcf-874a9a9f272c tempest-SnapshotsActionsTest-375113023 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-647080997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=261364e0-a1bd-445a-93cd-88ea053c65cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a005a3e26d94da4a3511d27a6b72c34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:50:51Z,use_quota=True,user_id='58671c73ab8447428bc8977b77d30ea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:50:51 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-c9fb2ad0-045e-416c-afcf-874a9a9f272c tempest-SnapshotsActionsTest-375113023 None] Creating volume 261364e0-a1bd-445a-93cd-88ea053c65cb {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:50:51 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-c9fb2ad0-045e-416c-afcf-874a9a9f272c tempest-SnapshotsActionsTest-375113023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:50:51 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-c9fb2ad0-045e-416c-afcf-874a9a9f272c tempest-SnapshotsActionsTest-375113023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:50:51 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-c9fb2ad0-045e-416c-afcf-874a9a9f272c tempest-SnapshotsActionsTest-375113023 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:50:51 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-c9fb2ad0-045e-416c-afcf-874a9a9f272c tempest-SnapshotsActionsTest-375113023 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:50:51 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-c9fb2ad0-045e-416c-afcf-874a9a9f272c tempest-SnapshotsActionsTest-375113023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:50:51 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-c9fb2ad0-045e-416c-afcf-874a9a9f272c tempest-SnapshotsActionsTest-375113023 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:50:51 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-c9fb2ad0-045e-416c-afcf-874a9a9f272c tempest-SnapshotsActionsTest-375113023 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:50:51 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c9fb2ad0-045e-416c-afcf-874a9a9f272c tempest-SnapshotsActionsTest-375113023 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:52 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=80, name=volume-261364e0-a1bd-445a-93cd-88ea053c65cb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:50:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c9fb2ad0-045e-416c-afcf-874a9a9f272c tempest-SnapshotsActionsTest-375113023 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb 1073741824" returned: 0 in 0.455s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c9fb2ad0-045e-416c-afcf-874a9a9f272c tempest-SnapshotsActionsTest-375113023 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c9fb2ad0-045e-416c-afcf-874a9a9f272c tempest-SnapshotsActionsTest-375113023 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb" returned: 0 in 0.158s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:52 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-c9fb2ad0-045e-416c-afcf-874a9a9f272c tempest-SnapshotsActionsTest-375113023 None] <== create_volume: return (690ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:50:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-c9fb2ad0-045e-416c-afcf-874a9a9f272c tempest-SnapshotsActionsTest-375113023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:50:52 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c9fb2ad0-045e-416c-afcf-874a9a9f272c tempest-SnapshotsActionsTest-375113023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ae3e184-1d85-4854-80d0-37de3d02a7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-261364e0-a1bd-445a-93cd-88ea053c65cb', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:50:52 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c9fb2ad0-045e-416c-afcf-874a9a9f272c tempest-SnapshotsActionsTest-375113023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dae1981-73d8-49a4-88cb-ee909277aed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:50:52 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-c9fb2ad0-045e-416c-afcf-874a9a9f272c tempest-SnapshotsActionsTest-375113023 None] Volume volume-261364e0-a1bd-445a-93cd-88ea053c65cb (261364e0-a1bd-445a-93cd-88ea053c65cb): created successfully
Sep 18 11:50:52 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c9fb2ad0-045e-416c-afcf-874a9a9f272c tempest-SnapshotsActionsTest-375113023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dae1981-73d8-49a4-88cb-ee909277aed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:50:52 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c9fb2ad0-045e-416c-afcf-874a9a9f272c tempest-SnapshotsActionsTest-375113023 None] Flow 'volume_create_manager' (22b79e67-7e89-456d-9216-ae58ee021820) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:50:53 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-c9fb2ad0-045e-416c-afcf-874a9a9f272c tempest-SnapshotsActionsTest-375113023 None] Created volume successfully.
Sep 18 11:50:53 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-ab45b6e3-b51e-4f95-9708-9082d91af7c4 tempest-SnapshotsActionsTest-375113023 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:50:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ab45b6e3-b51e-4f95-9708-9082d91af7c4 tempest-SnapshotsActionsTest-375113023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:50:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ab45b6e3-b51e-4f95-9708-9082d91af7c4 tempest-SnapshotsActionsTest-375113023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:50:53 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-ab45b6e3-b51e-4f95-9708-9082d91af7c4 tempest-SnapshotsActionsTest-375113023 None] Creating offline snapshot 1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe of volume 261364e0-a1bd-445a-93cd-88ea053c65cb {{(pid=83176) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 11:50:53 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac01a3e1-9525-4af6-aed0-ce043ab3cd1d]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:50:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ab45b6e3-b51e-4f95-9708-9082d91af7c4 tempest-SnapshotsActionsTest-375113023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ab45b6e3-b51e-4f95-9708-9082d91af7c4 tempest-SnapshotsActionsTest-375113023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb" returned: 0 in 0.521s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ab45b6e3-b51e-4f95-9708-9082d91af7c4 tempest-SnapshotsActionsTest-375113023 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe 1G {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:54 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=81, name=volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:50:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ab45b6e3-b51e-4f95-9708-9082d91af7c4 tempest-SnapshotsActionsTest-375113023 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe 1G" returned: 0 in 0.306s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ab45b6e3-b51e-4f95-9708-9082d91af7c4 tempest-SnapshotsActionsTest-375113023 None] Running cmd (subprocess): qemu-img rebase -u -b volume-261364e0-a1bd-445a-93cd-88ea053c65cb -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ab45b6e3-b51e-4f95-9708-9082d91af7c4 tempest-SnapshotsActionsTest-375113023 None] CMD "qemu-img rebase -u -b volume-261364e0-a1bd-445a-93cd-88ea053c65cb -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe" returned: 0 in 0.168s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:55 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-ab45b6e3-b51e-4f95-9708-9082d91af7c4 tempest-SnapshotsActionsTest-375113023 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 11:50:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ab45b6e3-b51e-4f95-9708-9082d91af7c4 tempest-SnapshotsActionsTest-375113023 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ab45b6e3-b51e-4f95-9708-9082d91af7c4 tempest-SnapshotsActionsTest-375113023 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe" returned: 0 in 0.102s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:55 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-ab45b6e3-b51e-4f95-9708-9082d91af7c4 tempest-SnapshotsActionsTest-375113023 None] Setting permissions: /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb -> 1000:1000 {{(pid=83176) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 11:50:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ab45b6e3-b51e-4f95-9708-9082d91af7c4 tempest-SnapshotsActionsTest-375113023 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ab45b6e3-b51e-4f95-9708-9082d91af7c4 tempest-SnapshotsActionsTest-375113023 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe" returned: 0 in 0.115s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ab45b6e3-b51e-4f95-9708-9082d91af7c4 tempest-SnapshotsActionsTest-375113023 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.info {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ab45b6e3-b51e-4f95-9708-9082d91af7c4 tempest-SnapshotsActionsTest-375113023 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.info" returned: 0 in 0.125s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:55 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-ab45b6e3-b51e-4f95-9708-9082d91af7c4 tempest-SnapshotsActionsTest-375113023 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.info is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 11:50:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ab45b6e3-b51e-4f95-9708-9082d91af7c4 tempest-SnapshotsActionsTest-375113023 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.info {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ab45b6e3-b51e-4f95-9708-9082d91af7c4 tempest-SnapshotsActionsTest-375113023 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.info" returned: 0 in 0.097s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ab45b6e3-b51e-4f95-9708-9082d91af7c4 tempest-SnapshotsActionsTest-375113023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.864s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:50:55 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-ab45b6e3-b51e-4f95-9708-9082d91af7c4 tempest-SnapshotsActionsTest-375113023 None] Create snapshot completed successfully
Sep 18 11:50:57 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-7443555e-5091-401c-a97c-7e68289c1eee tempest-SnapshotsActionsTest-375113023 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:50:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-7443555e-5091-401c-a97c-7e68289c1eee tempest-SnapshotsActionsTest-375113023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:50:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-7443555e-5091-401c-a97c-7e68289c1eee tempest-SnapshotsActionsTest-375113023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:50:57 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-7443555e-5091-401c-a97c-7e68289c1eee tempest-SnapshotsActionsTest-375113023 None] Creating offline snapshot 7b04ee15-4cd1-4ec2-94b4-7ba3c2eba40e of volume 261364e0-a1bd-445a-93cd-88ea053c65cb {{(pid=83176) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 11:50:57 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c1a57c-e5d4-49f2-a06e-84ceed546b7b]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:50:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7443555e-5091-401c-a97c-7e68289c1eee tempest-SnapshotsActionsTest-375113023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7443555e-5091-401c-a97c-7e68289c1eee tempest-SnapshotsActionsTest-375113023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe" returned: 0 in 0.463s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:58 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-7443555e-5091-401c-a97c-7e68289c1eee tempest-SnapshotsActionsTest-375113023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-261364e0-a1bd-445a-93cd-88ea053c65cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 11:50:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7443555e-5091-401c-a97c-7e68289c1eee tempest-SnapshotsActionsTest-375113023 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.7b04ee15-4cd1-4ec2-94b4-7ba3c2eba40e 1G {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:58 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=83, name=volume-261364e0-a1bd-445a-93cd-88ea053c65cb.7b04ee15-4cd1-4ec2-94b4-7ba3c2eba40e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:50:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7443555e-5091-401c-a97c-7e68289c1eee tempest-SnapshotsActionsTest-375113023 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.7b04ee15-4cd1-4ec2-94b4-7ba3c2eba40e 1G" returned: 0 in 0.311s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7443555e-5091-401c-a97c-7e68289c1eee tempest-SnapshotsActionsTest-375113023 None] Running cmd (subprocess): qemu-img rebase -u -b volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.7b04ee15-4cd1-4ec2-94b4-7ba3c2eba40e {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:59 devstack quobyte-client[83193]: System call of process 94361 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:50:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7443555e-5091-401c-a97c-7e68289c1eee tempest-SnapshotsActionsTest-375113023 None] CMD "qemu-img rebase -u -b volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.7b04ee15-4cd1-4ec2-94b4-7ba3c2eba40e" returned: 0 in 0.310s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:59 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-7443555e-5091-401c-a97c-7e68289c1eee tempest-SnapshotsActionsTest-375113023 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.7b04ee15-4cd1-4ec2-94b4-7ba3c2eba40e is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 11:50:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7443555e-5091-401c-a97c-7e68289c1eee tempest-SnapshotsActionsTest-375113023 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.7b04ee15-4cd1-4ec2-94b4-7ba3c2eba40e {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7443555e-5091-401c-a97c-7e68289c1eee tempest-SnapshotsActionsTest-375113023 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.7b04ee15-4cd1-4ec2-94b4-7ba3c2eba40e" returned: 0 in 0.113s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:59 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-7443555e-5091-401c-a97c-7e68289c1eee tempest-SnapshotsActionsTest-375113023 None] Setting permissions: /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe -> 1000:1000 {{(pid=83176) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 11:50:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7443555e-5091-401c-a97c-7e68289c1eee tempest-SnapshotsActionsTest-375113023 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.7b04ee15-4cd1-4ec2-94b4-7ba3c2eba40e {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:50:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7443555e-5091-401c-a97c-7e68289c1eee tempest-SnapshotsActionsTest-375113023 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.7b04ee15-4cd1-4ec2-94b4-7ba3c2eba40e" returned: 0 in 0.165s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:50:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-7443555e-5091-401c-a97c-7e68289c1eee tempest-SnapshotsActionsTest-375113023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.690s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:50:59 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-7443555e-5091-401c-a97c-7e68289c1eee tempest-SnapshotsActionsTest-375113023 None] Create snapshot completed successfully
Sep 18 11:51:01 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ee4d1d96-7c14-4fde-8be9-8c06adae1767 tempest-SnapshotsActionsTest-540702378 None] Acquiring lock "cinder-7b04ee15-4cd1-4ec2-94b4-7ba3c2eba40e-delete_snapshot" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:51:01 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ee4d1d96-7c14-4fde-8be9-8c06adae1767 tempest-SnapshotsActionsTest-540702378 None] Lock "cinder-7b04ee15-4cd1-4ec2-94b4-7ba3c2eba40e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.073s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:51:01 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-ee4d1d96-7c14-4fde-8be9-8c06adae1767 tempest-SnapshotsActionsTest-540702378 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:51:01 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ee4d1d96-7c14-4fde-8be9-8c06adae1767 tempest-SnapshotsActionsTest-540702378 None] Acquiring lock "cinder-quobyte-261364e0-a1bd-445a-93cd-88ea053c65cb" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:51:01 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ee4d1d96-7c14-4fde-8be9-8c06adae1767 tempest-SnapshotsActionsTest-540702378 None] Lock "cinder-quobyte-261364e0-a1bd-445a-93cd-88ea053c65cb" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:51:01 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ee4d1d96-7c14-4fde-8be9-8c06adae1767 tempest-SnapshotsActionsTest-540702378 None] Acquiring lock "cinder-quobyte-7b04ee15-4cd1-4ec2-94b4-7ba3c2eba40e" by "_delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:51:01 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ee4d1d96-7c14-4fde-8be9-8c06adae1767 tempest-SnapshotsActionsTest-540702378 None] Lock "cinder-quobyte-7b04ee15-4cd1-4ec2-94b4-7ba3c2eba40e" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:51:01 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-ee4d1d96-7c14-4fde-8be9-8c06adae1767 tempest-SnapshotsActionsTest-540702378 None] Deleting offline snapshot 7b04ee15-4cd1-4ec2-94b4-7ba3c2eba40e of volume 261364e0-a1bd-445a-93cd-88ea053c65cb {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 11:51:01 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-ee4d1d96-7c14-4fde-8be9-8c06adae1767 tempest-SnapshotsActionsTest-540702378 None] snapshot_file for this snap is: volume-261364e0-a1bd-445a-93cd-88ea053c65cb.7b04ee15-4cd1-4ec2-94b4-7ba3c2eba40e {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 11:51:01 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f399fdf4-338d-45a1-81d2-13c5b8855a47]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:51:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ee4d1d96-7c14-4fde-8be9-8c06adae1767 tempest-SnapshotsActionsTest-540702378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.7b04ee15-4cd1-4ec2-94b4-7ba3c2eba40e {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ee4d1d96-7c14-4fde-8be9-8c06adae1767 tempest-SnapshotsActionsTest-540702378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.7b04ee15-4cd1-4ec2-94b4-7ba3c2eba40e" returned: 0 in 0.463s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:01 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-ee4d1d96-7c14-4fde-8be9-8c06adae1767 tempest-SnapshotsActionsTest-540702378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-261364e0-a1bd-445a-93cd-88ea053c65cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 11:51:02 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfeed4e3-f922-474c-8923-73ef998fd94f]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:51:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ee4d1d96-7c14-4fde-8be9-8c06adae1767 tempest-SnapshotsActionsTest-540702378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:02 devstack quobyte-client[83193]: System call of process 94378 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:51:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ee4d1d96-7c14-4fde-8be9-8c06adae1767 tempest-SnapshotsActionsTest-540702378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe" returned: 0 in 0.497s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:02 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-ee4d1d96-7c14-4fde-8be9-8c06adae1767 tempest-SnapshotsActionsTest-540702378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-261364e0-a1bd-445a-93cd-88ea053c65cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 11:51:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ee4d1d96-7c14-4fde-8be9-8c06adae1767 tempest-SnapshotsActionsTest-540702378 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.7b04ee15-4cd1-4ec2-94b4-7ba3c2eba40e {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ee4d1d96-7c14-4fde-8be9-8c06adae1767 tempest-SnapshotsActionsTest-540702378 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.7b04ee15-4cd1-4ec2-94b4-7ba3c2eba40e" returned: 0 in 0.312s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ee4d1d96-7c14-4fde-8be9-8c06adae1767 tempest-SnapshotsActionsTest-540702378 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.7b04ee15-4cd1-4ec2-94b4-7ba3c2eba40e {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:03 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ee4d1d96-7c14-4fde-8be9-8c06adae1767 tempest-SnapshotsActionsTest-540702378 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.7b04ee15-4cd1-4ec2-94b4-7ba3c2eba40e" returned: 0 in 0.158s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:03 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ee4d1d96-7c14-4fde-8be9-8c06adae1767 tempest-SnapshotsActionsTest-540702378 None] Lock "cinder-quobyte-7b04ee15-4cd1-4ec2-94b4-7ba3c2eba40e" released by "_delete_snapshot" :: held 1.842s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:51:03 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ee4d1d96-7c14-4fde-8be9-8c06adae1767 tempest-SnapshotsActionsTest-540702378 None] Lock "cinder-quobyte-261364e0-a1bd-445a-93cd-88ea053c65cb" released by "delete_snapshot" :: held 1.897s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:51:03 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-ee4d1d96-7c14-4fde-8be9-8c06adae1767 tempest-SnapshotsActionsTest-540702378 None] Created reservations ['b182bb9a-fa2f-4513-96fd-09b2a79a3317', '758b93f7-42de-4e0e-aa0b-9ce60d195575', 'e2516208-2a87-4df1-b20d-5c7286fb1962', '3ba42fa7-3a46-4eff-872b-cddeea5c7ab4'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:51:03 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-ee4d1d96-7c14-4fde-8be9-8c06adae1767 tempest-SnapshotsActionsTest-540702378 None] Delete snapshot completed successfully.
Sep 18 11:51:03 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ee4d1d96-7c14-4fde-8be9-8c06adae1767 tempest-SnapshotsActionsTest-540702378 None] Lock "cinder-7b04ee15-4cd1-4ec2-94b4-7ba3c2eba40e-delete_snapshot" released by "delete_snapshot" :: held 2.378s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:51:05 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-87746732-068e-4068-82a1-969b0f4e1205 tempest-SnapshotsActionsTest-375113023 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:51:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-87746732-068e-4068-82a1-969b0f4e1205 tempest-SnapshotsActionsTest-375113023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:51:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-87746732-068e-4068-82a1-969b0f4e1205 tempest-SnapshotsActionsTest-375113023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:51:05 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-87746732-068e-4068-82a1-969b0f4e1205 tempest-SnapshotsActionsTest-375113023 None] Creating offline snapshot 396a00f7-1805-4c33-8541-817e5d7d6c94 of volume 261364e0-a1bd-445a-93cd-88ea053c65cb {{(pid=83176) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 11:51:05 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[377381aa-7e1a-4f92-805a-26bd90a18bde]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:51:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-87746732-068e-4068-82a1-969b0f4e1205 tempest-SnapshotsActionsTest-375113023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-87746732-068e-4068-82a1-969b0f4e1205 tempest-SnapshotsActionsTest-375113023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe" returned: 0 in 0.524s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:05 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-87746732-068e-4068-82a1-969b0f4e1205 tempest-SnapshotsActionsTest-375113023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-261364e0-a1bd-445a-93cd-88ea053c65cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 11:51:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-87746732-068e-4068-82a1-969b0f4e1205 tempest-SnapshotsActionsTest-375113023 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.396a00f7-1805-4c33-8541-817e5d7d6c94 1G {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:06 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=84, name=volume-261364e0-a1bd-445a-93cd-88ea053c65cb.396a00f7-1805-4c33-8541-817e5d7d6c94, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:51:06 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-87746732-068e-4068-82a1-969b0f4e1205 tempest-SnapshotsActionsTest-375113023 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.396a00f7-1805-4c33-8541-817e5d7d6c94 1G" returned: 0 in 0.286s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:06 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-87746732-068e-4068-82a1-969b0f4e1205 tempest-SnapshotsActionsTest-375113023 None] Running cmd (subprocess): qemu-img rebase -u -b volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.396a00f7-1805-4c33-8541-817e5d7d6c94 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:06 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-87746732-068e-4068-82a1-969b0f4e1205 tempest-SnapshotsActionsTest-375113023 None] CMD "qemu-img rebase -u -b volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.396a00f7-1805-4c33-8541-817e5d7d6c94" returned: 0 in 0.162s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:06 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-87746732-068e-4068-82a1-969b0f4e1205 tempest-SnapshotsActionsTest-375113023 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.396a00f7-1805-4c33-8541-817e5d7d6c94 is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 11:51:06 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-87746732-068e-4068-82a1-969b0f4e1205 tempest-SnapshotsActionsTest-375113023 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.396a00f7-1805-4c33-8541-817e5d7d6c94 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:06 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-87746732-068e-4068-82a1-969b0f4e1205 tempest-SnapshotsActionsTest-375113023 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.396a00f7-1805-4c33-8541-817e5d7d6c94" returned: 0 in 0.107s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:06 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-87746732-068e-4068-82a1-969b0f4e1205 tempest-SnapshotsActionsTest-375113023 None] Setting permissions: /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe -> 1000:1000 {{(pid=83176) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 11:51:06 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-87746732-068e-4068-82a1-969b0f4e1205 tempest-SnapshotsActionsTest-375113023 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.396a00f7-1805-4c33-8541-817e5d7d6c94 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:06 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-87746732-068e-4068-82a1-969b0f4e1205 tempest-SnapshotsActionsTest-375113023 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.396a00f7-1805-4c33-8541-817e5d7d6c94" returned: 0 in 0.160s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:06 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-87746732-068e-4068-82a1-969b0f4e1205 tempest-SnapshotsActionsTest-375113023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.527s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:51:07 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-87746732-068e-4068-82a1-969b0f4e1205 tempest-SnapshotsActionsTest-375113023 None] Create snapshot completed successfully
Sep 18 11:51:07 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-038d1676-7c31-4639-95e3-051fbd2cf8cc tempest-SnapshotsActionsTest-540702378 None] Acquiring lock "cinder-396a00f7-1805-4c33-8541-817e5d7d6c94-delete_snapshot" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:51:07 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-038d1676-7c31-4639-95e3-051fbd2cf8cc tempest-SnapshotsActionsTest-540702378 None] Lock "cinder-396a00f7-1805-4c33-8541-817e5d7d6c94-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:51:07 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-038d1676-7c31-4639-95e3-051fbd2cf8cc tempest-SnapshotsActionsTest-540702378 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:51:07 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-038d1676-7c31-4639-95e3-051fbd2cf8cc tempest-SnapshotsActionsTest-540702378 None] Acquiring lock "cinder-quobyte-261364e0-a1bd-445a-93cd-88ea053c65cb" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:51:07 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-038d1676-7c31-4639-95e3-051fbd2cf8cc tempest-SnapshotsActionsTest-540702378 None] Lock "cinder-quobyte-261364e0-a1bd-445a-93cd-88ea053c65cb" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:51:07 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-038d1676-7c31-4639-95e3-051fbd2cf8cc tempest-SnapshotsActionsTest-540702378 None] Acquiring lock "cinder-quobyte-396a00f7-1805-4c33-8541-817e5d7d6c94" by "_delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:51:07 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-038d1676-7c31-4639-95e3-051fbd2cf8cc tempest-SnapshotsActionsTest-540702378 None] Lock "cinder-quobyte-396a00f7-1805-4c33-8541-817e5d7d6c94" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:51:07 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-038d1676-7c31-4639-95e3-051fbd2cf8cc tempest-SnapshotsActionsTest-540702378 None] Deleting offline snapshot 396a00f7-1805-4c33-8541-817e5d7d6c94 of volume 261364e0-a1bd-445a-93cd-88ea053c65cb {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 11:51:07 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-038d1676-7c31-4639-95e3-051fbd2cf8cc tempest-SnapshotsActionsTest-540702378 None] snapshot_file for this snap is: volume-261364e0-a1bd-445a-93cd-88ea053c65cb.396a00f7-1805-4c33-8541-817e5d7d6c94 {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 11:51:07 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0896410-fa82-4cdb-b38b-86a5fdd40d48]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:51:07 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-038d1676-7c31-4639-95e3-051fbd2cf8cc tempest-SnapshotsActionsTest-540702378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.396a00f7-1805-4c33-8541-817e5d7d6c94 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:07 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-038d1676-7c31-4639-95e3-051fbd2cf8cc tempest-SnapshotsActionsTest-540702378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.396a00f7-1805-4c33-8541-817e5d7d6c94" returned: 0 in 0.429s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:07 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-038d1676-7c31-4639-95e3-051fbd2cf8cc tempest-SnapshotsActionsTest-540702378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-261364e0-a1bd-445a-93cd-88ea053c65cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 11:51:08 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[988887d6-bb27-4797-97f5-f1b75958f418]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:51:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-038d1676-7c31-4639-95e3-051fbd2cf8cc tempest-SnapshotsActionsTest-540702378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-038d1676-7c31-4639-95e3-051fbd2cf8cc tempest-SnapshotsActionsTest-540702378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe" returned: 0 in 0.461s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:08 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-038d1676-7c31-4639-95e3-051fbd2cf8cc tempest-SnapshotsActionsTest-540702378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-261364e0-a1bd-445a-93cd-88ea053c65cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 11:51:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-038d1676-7c31-4639-95e3-051fbd2cf8cc tempest-SnapshotsActionsTest-540702378 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.396a00f7-1805-4c33-8541-817e5d7d6c94 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-038d1676-7c31-4639-95e3-051fbd2cf8cc tempest-SnapshotsActionsTest-540702378 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.396a00f7-1805-4c33-8541-817e5d7d6c94" returned: 0 in 0.264s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-038d1676-7c31-4639-95e3-051fbd2cf8cc tempest-SnapshotsActionsTest-540702378 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.396a00f7-1805-4c33-8541-817e5d7d6c94 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-038d1676-7c31-4639-95e3-051fbd2cf8cc tempest-SnapshotsActionsTest-540702378 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.396a00f7-1805-4c33-8541-817e5d7d6c94" returned: 0 in 0.108s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:09 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-038d1676-7c31-4639-95e3-051fbd2cf8cc tempest-SnapshotsActionsTest-540702378 None] Lock "cinder-quobyte-396a00f7-1805-4c33-8541-817e5d7d6c94" released by "_delete_snapshot" :: held 1.613s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:51:09 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-038d1676-7c31-4639-95e3-051fbd2cf8cc tempest-SnapshotsActionsTest-540702378 None] Lock "cinder-quobyte-261364e0-a1bd-445a-93cd-88ea053c65cb" released by "delete_snapshot" :: held 1.638s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:51:09 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-038d1676-7c31-4639-95e3-051fbd2cf8cc tempest-SnapshotsActionsTest-540702378 None] Created reservations ['c8fb67cc-abd0-48b5-ad62-ab2ad6f5962f', '8488d427-fcee-4533-8dd2-4b4e3a00bbbb', '4803c627-b3eb-4af4-8717-a2f182375083', 'c54dbda8-eb7a-4cc8-9639-c4eac802e66e'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:51:09 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-038d1676-7c31-4639-95e3-051fbd2cf8cc tempest-SnapshotsActionsTest-540702378 None] Delete snapshot completed successfully.
Sep 18 11:51:09 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-038d1676-7c31-4639-95e3-051fbd2cf8cc tempest-SnapshotsActionsTest-540702378 None] Lock "cinder-396a00f7-1805-4c33-8541-817e5d7d6c94-delete_snapshot" released by "delete_snapshot" :: held 2.296s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:51:11 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-455d42d4-9f80-472f-9efc-50b0d3d75ebf tempest-SnapshotsActionsTest-375113023 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:51:11 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-455d42d4-9f80-472f-9efc-50b0d3d75ebf tempest-SnapshotsActionsTest-375113023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:51:11 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-455d42d4-9f80-472f-9efc-50b0d3d75ebf tempest-SnapshotsActionsTest-375113023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:51:11 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-455d42d4-9f80-472f-9efc-50b0d3d75ebf tempest-SnapshotsActionsTest-375113023 None] Creating offline snapshot 9aaca26b-c976-4d1b-adb4-738cc990f659 of volume 261364e0-a1bd-445a-93cd-88ea053c65cb {{(pid=83176) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 11:51:11 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57f5c89-11f2-4385-9a2d-3a62a55ae890]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:51:11 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-455d42d4-9f80-472f-9efc-50b0d3d75ebf tempest-SnapshotsActionsTest-375113023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:11 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-455d42d4-9f80-472f-9efc-50b0d3d75ebf tempest-SnapshotsActionsTest-375113023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe" returned: 0 in 0.516s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:11 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-455d42d4-9f80-472f-9efc-50b0d3d75ebf tempest-SnapshotsActionsTest-375113023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-261364e0-a1bd-445a-93cd-88ea053c65cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 11:51:11 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-455d42d4-9f80-472f-9efc-50b0d3d75ebf tempest-SnapshotsActionsTest-375113023 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.9aaca26b-c976-4d1b-adb4-738cc990f659 1G {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:11 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=85, name=volume-261364e0-a1bd-445a-93cd-88ea053c65cb.9aaca26b-c976-4d1b-adb4-738cc990f659, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:51:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-455d42d4-9f80-472f-9efc-50b0d3d75ebf tempest-SnapshotsActionsTest-375113023 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.9aaca26b-c976-4d1b-adb4-738cc990f659 1G" returned: 0 in 0.335s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-455d42d4-9f80-472f-9efc-50b0d3d75ebf tempest-SnapshotsActionsTest-375113023 None] Running cmd (subprocess): qemu-img rebase -u -b volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.9aaca26b-c976-4d1b-adb4-738cc990f659 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:12 devstack quobyte-client[83193]: System call of process 94414 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:51:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-455d42d4-9f80-472f-9efc-50b0d3d75ebf tempest-SnapshotsActionsTest-375113023 None] CMD "qemu-img rebase -u -b volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.9aaca26b-c976-4d1b-adb4-738cc990f659" returned: 0 in 0.236s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:12 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-455d42d4-9f80-472f-9efc-50b0d3d75ebf tempest-SnapshotsActionsTest-375113023 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.9aaca26b-c976-4d1b-adb4-738cc990f659 is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 11:51:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-455d42d4-9f80-472f-9efc-50b0d3d75ebf tempest-SnapshotsActionsTest-375113023 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.9aaca26b-c976-4d1b-adb4-738cc990f659 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-455d42d4-9f80-472f-9efc-50b0d3d75ebf tempest-SnapshotsActionsTest-375113023 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.9aaca26b-c976-4d1b-adb4-738cc990f659" returned: 0 in 0.162s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:12 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-455d42d4-9f80-472f-9efc-50b0d3d75ebf tempest-SnapshotsActionsTest-375113023 None] Setting permissions: /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe -> 1000:1000 {{(pid=83176) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 11:51:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-455d42d4-9f80-472f-9efc-50b0d3d75ebf tempest-SnapshotsActionsTest-375113023 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.9aaca26b-c976-4d1b-adb4-738cc990f659 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-455d42d4-9f80-472f-9efc-50b0d3d75ebf tempest-SnapshotsActionsTest-375113023 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.9aaca26b-c976-4d1b-adb4-738cc990f659" returned: 0 in 0.160s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-455d42d4-9f80-472f-9efc-50b0d3d75ebf tempest-SnapshotsActionsTest-375113023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.767s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:51:13 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-455d42d4-9f80-472f-9efc-50b0d3d75ebf tempest-SnapshotsActionsTest-375113023 None] Create snapshot completed successfully
Sep 18 11:51:13 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 11:51:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:51:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:51:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:51:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:51:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:51:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.144s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:14 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:51:14 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-8b5d61b3-7edf-43d7-b320-34e888cd5c6a tempest-SnapshotsActionsTest-540702378 None] Acquiring lock "cinder-9aaca26b-c976-4d1b-adb4-738cc990f659-delete_snapshot" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:51:14 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-8b5d61b3-7edf-43d7-b320-34e888cd5c6a tempest-SnapshotsActionsTest-540702378 None] Lock "cinder-9aaca26b-c976-4d1b-adb4-738cc990f659-delete_snapshot" acquired by "delete_snapshot" :: waited 0.088s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:51:14 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-8b5d61b3-7edf-43d7-b320-34e888cd5c6a tempest-SnapshotsActionsTest-540702378 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:51:14 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-8b5d61b3-7edf-43d7-b320-34e888cd5c6a tempest-SnapshotsActionsTest-540702378 None] Acquiring lock "cinder-quobyte-261364e0-a1bd-445a-93cd-88ea053c65cb" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:51:14 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-8b5d61b3-7edf-43d7-b320-34e888cd5c6a tempest-SnapshotsActionsTest-540702378 None] Lock "cinder-quobyte-261364e0-a1bd-445a-93cd-88ea053c65cb" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:51:14 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-8b5d61b3-7edf-43d7-b320-34e888cd5c6a tempest-SnapshotsActionsTest-540702378 None] Acquiring lock "cinder-quobyte-9aaca26b-c976-4d1b-adb4-738cc990f659" by "_delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:51:14 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-8b5d61b3-7edf-43d7-b320-34e888cd5c6a tempest-SnapshotsActionsTest-540702378 None] Lock "cinder-quobyte-9aaca26b-c976-4d1b-adb4-738cc990f659" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:51:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-8b5d61b3-7edf-43d7-b320-34e888cd5c6a tempest-SnapshotsActionsTest-540702378 None] Deleting offline snapshot 9aaca26b-c976-4d1b-adb4-738cc990f659 of volume 261364e0-a1bd-445a-93cd-88ea053c65cb {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 11:51:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-8b5d61b3-7edf-43d7-b320-34e888cd5c6a tempest-SnapshotsActionsTest-540702378 None] snapshot_file for this snap is: volume-261364e0-a1bd-445a-93cd-88ea053c65cb.9aaca26b-c976-4d1b-adb4-738cc990f659 {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 11:51:14 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a1c817-de7e-4b30-8965-38580c3b0eb3]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:51:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8b5d61b3-7edf-43d7-b320-34e888cd5c6a tempest-SnapshotsActionsTest-540702378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.9aaca26b-c976-4d1b-adb4-738cc990f659 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8b5d61b3-7edf-43d7-b320-34e888cd5c6a tempest-SnapshotsActionsTest-540702378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.9aaca26b-c976-4d1b-adb4-738cc990f659" returned: 0 in 0.551s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:15 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-8b5d61b3-7edf-43d7-b320-34e888cd5c6a tempest-SnapshotsActionsTest-540702378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-261364e0-a1bd-445a-93cd-88ea053c65cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 11:51:15 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f62dbf-caef-4680-8379-76812344c4d4]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:51:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8b5d61b3-7edf-43d7-b320-34e888cd5c6a tempest-SnapshotsActionsTest-540702378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:16 devstack quobyte-client[83193]: System call of process 94424 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:51:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8b5d61b3-7edf-43d7-b320-34e888cd5c6a tempest-SnapshotsActionsTest-540702378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe" returned: 0 in 0.541s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:16 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-8b5d61b3-7edf-43d7-b320-34e888cd5c6a tempest-SnapshotsActionsTest-540702378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-261364e0-a1bd-445a-93cd-88ea053c65cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 11:51:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8b5d61b3-7edf-43d7-b320-34e888cd5c6a tempest-SnapshotsActionsTest-540702378 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.9aaca26b-c976-4d1b-adb4-738cc990f659 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8b5d61b3-7edf-43d7-b320-34e888cd5c6a tempest-SnapshotsActionsTest-540702378 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.9aaca26b-c976-4d1b-adb4-738cc990f659" returned: 0 in 0.282s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8b5d61b3-7edf-43d7-b320-34e888cd5c6a tempest-SnapshotsActionsTest-540702378 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.9aaca26b-c976-4d1b-adb4-738cc990f659 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8b5d61b3-7edf-43d7-b320-34e888cd5c6a tempest-SnapshotsActionsTest-540702378 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.9aaca26b-c976-4d1b-adb4-738cc990f659" returned: 0 in 0.232s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:16 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-8b5d61b3-7edf-43d7-b320-34e888cd5c6a tempest-SnapshotsActionsTest-540702378 None] Lock "cinder-quobyte-9aaca26b-c976-4d1b-adb4-738cc990f659" released by "_delete_snapshot" :: held 2.043s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:51:16 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-8b5d61b3-7edf-43d7-b320-34e888cd5c6a tempest-SnapshotsActionsTest-540702378 None] Lock "cinder-quobyte-261364e0-a1bd-445a-93cd-88ea053c65cb" released by "delete_snapshot" :: held 2.096s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:51:17 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-8b5d61b3-7edf-43d7-b320-34e888cd5c6a tempest-SnapshotsActionsTest-540702378 None] Created reservations ['040bb42b-72d4-45f9-bd08-d974437986b1', 'f644c1fc-f87b-4562-9ab3-3c1f5bbe5a47', '3ed0abe7-3054-406a-87af-2ce9445e9839', '1f529d15-af99-4df0-aa2d-b6265c6b51cb'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:51:17 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-8b5d61b3-7edf-43d7-b320-34e888cd5c6a tempest-SnapshotsActionsTest-540702378 None] Delete snapshot completed successfully.
Sep 18 11:51:17 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-8b5d61b3-7edf-43d7-b320-34e888cd5c6a tempest-SnapshotsActionsTest-540702378 None] Lock "cinder-9aaca26b-c976-4d1b-adb4-738cc990f659-delete_snapshot" released by "delete_snapshot" :: held 2.790s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:51:18 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-5bbaae2b-e5cd-4a28-99de-b12828c259e7 tempest-SnapshotsActionsTest-375113023 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:51:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-5bbaae2b-e5cd-4a28-99de-b12828c259e7 tempest-SnapshotsActionsTest-375113023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:51:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-5bbaae2b-e5cd-4a28-99de-b12828c259e7 tempest-SnapshotsActionsTest-375113023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:51:18 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-5bbaae2b-e5cd-4a28-99de-b12828c259e7 tempest-SnapshotsActionsTest-375113023 None] Creating offline snapshot 102a0dc0-5675-4cb3-804e-6d0f2d3d67d6 of volume 261364e0-a1bd-445a-93cd-88ea053c65cb {{(pid=83176) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 11:51:18 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d517d2cd-1ecb-4684-a395-bb9d4617222f]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:51:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5bbaae2b-e5cd-4a28-99de-b12828c259e7 tempest-SnapshotsActionsTest-375113023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5bbaae2b-e5cd-4a28-99de-b12828c259e7 tempest-SnapshotsActionsTest-375113023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe" returned: 0 in 0.533s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:18 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-5bbaae2b-e5cd-4a28-99de-b12828c259e7 tempest-SnapshotsActionsTest-375113023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-261364e0-a1bd-445a-93cd-88ea053c65cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 11:51:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5bbaae2b-e5cd-4a28-99de-b12828c259e7 tempest-SnapshotsActionsTest-375113023 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.102a0dc0-5675-4cb3-804e-6d0f2d3d67d6 1G {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:19 devstack quobyte-client[83193]: System call of process 94434 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:51:19 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=86, name=volume-261364e0-a1bd-445a-93cd-88ea053c65cb.102a0dc0-5675-4cb3-804e-6d0f2d3d67d6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:51:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5bbaae2b-e5cd-4a28-99de-b12828c259e7 tempest-SnapshotsActionsTest-375113023 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.102a0dc0-5675-4cb3-804e-6d0f2d3d67d6 1G" returned: 0 in 0.306s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5bbaae2b-e5cd-4a28-99de-b12828c259e7 tempest-SnapshotsActionsTest-375113023 None] Running cmd (subprocess): qemu-img rebase -u -b volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.102a0dc0-5675-4cb3-804e-6d0f2d3d67d6 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:19 devstack quobyte-client[83193]: System call of process 94437 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:51:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5bbaae2b-e5cd-4a28-99de-b12828c259e7 tempest-SnapshotsActionsTest-375113023 None] CMD "qemu-img rebase -u -b volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.102a0dc0-5675-4cb3-804e-6d0f2d3d67d6" returned: 0 in 0.176s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:19 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-5bbaae2b-e5cd-4a28-99de-b12828c259e7 tempest-SnapshotsActionsTest-375113023 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.102a0dc0-5675-4cb3-804e-6d0f2d3d67d6 is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 11:51:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5bbaae2b-e5cd-4a28-99de-b12828c259e7 tempest-SnapshotsActionsTest-375113023 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.102a0dc0-5675-4cb3-804e-6d0f2d3d67d6 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5bbaae2b-e5cd-4a28-99de-b12828c259e7 tempest-SnapshotsActionsTest-375113023 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.102a0dc0-5675-4cb3-804e-6d0f2d3d67d6" returned: 0 in 0.096s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:19 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-5bbaae2b-e5cd-4a28-99de-b12828c259e7 tempest-SnapshotsActionsTest-375113023 None] Setting permissions: /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe -> 1000:1000 {{(pid=83176) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 11:51:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5bbaae2b-e5cd-4a28-99de-b12828c259e7 tempest-SnapshotsActionsTest-375113023 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.102a0dc0-5675-4cb3-804e-6d0f2d3d67d6 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5bbaae2b-e5cd-4a28-99de-b12828c259e7 tempest-SnapshotsActionsTest-375113023 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.102a0dc0-5675-4cb3-804e-6d0f2d3d67d6" returned: 0 in 0.102s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-5bbaae2b-e5cd-4a28-99de-b12828c259e7 tempest-SnapshotsActionsTest-375113023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.516s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:51:19 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=61,cinder:UPDATE=55,cinder:DELETE=5,cinder:INSERT=14 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:51:20 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=56,cinder:UPDATE=63,cinder:DELETE=3,cinder:INSERT=12 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:51:20 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-5bbaae2b-e5cd-4a28-99de-b12828c259e7 tempest-SnapshotsActionsTest-375113023 None] Create snapshot completed successfully
Sep 18 11:51:20 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4c7ef089-1e32-4d89-9e0e-a00b9bac4142 tempest-SnapshotsActionsTest-540702378 None] Acquiring lock "cinder-102a0dc0-5675-4cb3-804e-6d0f2d3d67d6-delete_snapshot" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:51:20 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4c7ef089-1e32-4d89-9e0e-a00b9bac4142 tempest-SnapshotsActionsTest-540702378 None] Lock "cinder-102a0dc0-5675-4cb3-804e-6d0f2d3d67d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:51:20 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-4c7ef089-1e32-4d89-9e0e-a00b9bac4142 tempest-SnapshotsActionsTest-540702378 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:51:20 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4c7ef089-1e32-4d89-9e0e-a00b9bac4142 tempest-SnapshotsActionsTest-540702378 None] Acquiring lock "cinder-quobyte-261364e0-a1bd-445a-93cd-88ea053c65cb" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:51:20 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4c7ef089-1e32-4d89-9e0e-a00b9bac4142 tempest-SnapshotsActionsTest-540702378 None] Lock "cinder-quobyte-261364e0-a1bd-445a-93cd-88ea053c65cb" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:51:20 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4c7ef089-1e32-4d89-9e0e-a00b9bac4142 tempest-SnapshotsActionsTest-540702378 None] Acquiring lock "cinder-quobyte-102a0dc0-5675-4cb3-804e-6d0f2d3d67d6" by "_delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:51:20 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4c7ef089-1e32-4d89-9e0e-a00b9bac4142 tempest-SnapshotsActionsTest-540702378 None] Lock "cinder-quobyte-102a0dc0-5675-4cb3-804e-6d0f2d3d67d6" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:51:20 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-4c7ef089-1e32-4d89-9e0e-a00b9bac4142 tempest-SnapshotsActionsTest-540702378 None] Deleting offline snapshot 102a0dc0-5675-4cb3-804e-6d0f2d3d67d6 of volume 261364e0-a1bd-445a-93cd-88ea053c65cb {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 11:51:20 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-4c7ef089-1e32-4d89-9e0e-a00b9bac4142 tempest-SnapshotsActionsTest-540702378 None] snapshot_file for this snap is: volume-261364e0-a1bd-445a-93cd-88ea053c65cb.102a0dc0-5675-4cb3-804e-6d0f2d3d67d6 {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 11:51:20 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d80e45e-46d5-4d12-a623-4d4440244d2b]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:51:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4c7ef089-1e32-4d89-9e0e-a00b9bac4142 tempest-SnapshotsActionsTest-540702378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.102a0dc0-5675-4cb3-804e-6d0f2d3d67d6 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4c7ef089-1e32-4d89-9e0e-a00b9bac4142 tempest-SnapshotsActionsTest-540702378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.102a0dc0-5675-4cb3-804e-6d0f2d3d67d6" returned: 0 in 0.406s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:21 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-4c7ef089-1e32-4d89-9e0e-a00b9bac4142 tempest-SnapshotsActionsTest-540702378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-261364e0-a1bd-445a-93cd-88ea053c65cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 11:51:21 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2d389e-343c-417d-975f-32a71fcd6cc0]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:51:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4c7ef089-1e32-4d89-9e0e-a00b9bac4142 tempest-SnapshotsActionsTest-540702378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:21 devstack quobyte-client[83193]: System call of process 94445 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:51:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4c7ef089-1e32-4d89-9e0e-a00b9bac4142 tempest-SnapshotsActionsTest-540702378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe" returned: 0 in 0.443s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:21 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-4c7ef089-1e32-4d89-9e0e-a00b9bac4142 tempest-SnapshotsActionsTest-540702378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-261364e0-a1bd-445a-93cd-88ea053c65cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 11:51:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4c7ef089-1e32-4d89-9e0e-a00b9bac4142 tempest-SnapshotsActionsTest-540702378 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.102a0dc0-5675-4cb3-804e-6d0f2d3d67d6 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4c7ef089-1e32-4d89-9e0e-a00b9bac4142 tempest-SnapshotsActionsTest-540702378 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.102a0dc0-5675-4cb3-804e-6d0f2d3d67d6" returned: 0 in 0.235s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4c7ef089-1e32-4d89-9e0e-a00b9bac4142 tempest-SnapshotsActionsTest-540702378 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.102a0dc0-5675-4cb3-804e-6d0f2d3d67d6 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4c7ef089-1e32-4d89-9e0e-a00b9bac4142 tempest-SnapshotsActionsTest-540702378 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.102a0dc0-5675-4cb3-804e-6d0f2d3d67d6" returned: 0 in 0.090s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:22 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4c7ef089-1e32-4d89-9e0e-a00b9bac4142 tempest-SnapshotsActionsTest-540702378 None] Lock "cinder-quobyte-102a0dc0-5675-4cb3-804e-6d0f2d3d67d6" released by "_delete_snapshot" :: held 1.518s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:51:22 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4c7ef089-1e32-4d89-9e0e-a00b9bac4142 tempest-SnapshotsActionsTest-540702378 None] Lock "cinder-quobyte-261364e0-a1bd-445a-93cd-88ea053c65cb" released by "delete_snapshot" :: held 1.542s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:51:22 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-4c7ef089-1e32-4d89-9e0e-a00b9bac4142 tempest-SnapshotsActionsTest-540702378 None] Created reservations ['5d9d5ae2-70fc-4009-a147-f8b286851c89', '8926a7d9-b808-4882-9166-0d69992a9961', 'f37e8b70-80e3-42a6-8551-81034d893909', '9642256a-acf2-431f-93bf-6f8085b55b81'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:51:22 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-4c7ef089-1e32-4d89-9e0e-a00b9bac4142 tempest-SnapshotsActionsTest-540702378 None] Delete snapshot completed successfully.
Sep 18 11:51:22 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4c7ef089-1e32-4d89-9e0e-a00b9bac4142 tempest-SnapshotsActionsTest-540702378 None] Lock "cinder-102a0dc0-5675-4cb3-804e-6d0f2d3d67d6-delete_snapshot" released by "delete_snapshot" :: held 2.110s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:51:24 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-690e2444-9e05-414f-833b-8ad7f29800a5 tempest-SnapshotsActionsTest-375113023 None] Acquiring lock "cinder-1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe-delete_snapshot" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:51:24 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-690e2444-9e05-414f-833b-8ad7f29800a5 tempest-SnapshotsActionsTest-375113023 None] Lock "cinder-1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:51:24 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-690e2444-9e05-414f-833b-8ad7f29800a5 tempest-SnapshotsActionsTest-375113023 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:51:24 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-690e2444-9e05-414f-833b-8ad7f29800a5 tempest-SnapshotsActionsTest-375113023 None] Acquiring lock "cinder-quobyte-261364e0-a1bd-445a-93cd-88ea053c65cb" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:51:24 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-690e2444-9e05-414f-833b-8ad7f29800a5 tempest-SnapshotsActionsTest-375113023 None] Lock "cinder-quobyte-261364e0-a1bd-445a-93cd-88ea053c65cb" acquired by "delete_snapshot" :: waited 0.036s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:51:24 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-690e2444-9e05-414f-833b-8ad7f29800a5 tempest-SnapshotsActionsTest-375113023 None] Acquiring lock "cinder-quobyte-1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe" by "_delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:51:24 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-690e2444-9e05-414f-833b-8ad7f29800a5 tempest-SnapshotsActionsTest-375113023 None] Lock "cinder-quobyte-1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:51:24 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-690e2444-9e05-414f-833b-8ad7f29800a5 tempest-SnapshotsActionsTest-375113023 None] Deleting offline snapshot 1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe of volume 261364e0-a1bd-445a-93cd-88ea053c65cb {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 11:51:24 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-690e2444-9e05-414f-833b-8ad7f29800a5 tempest-SnapshotsActionsTest-375113023 None] snapshot_file for this snap is: volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 11:51:24 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[43213fd4-4386-4698-b479-15cf56191a74]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:51:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-690e2444-9e05-414f-833b-8ad7f29800a5 tempest-SnapshotsActionsTest-375113023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:25 devstack quobyte-client[83193]: System call of process 94453 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:51:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-690e2444-9e05-414f-833b-8ad7f29800a5 tempest-SnapshotsActionsTest-375113023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe" returned: 0 in 0.803s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:25 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-690e2444-9e05-414f-833b-8ad7f29800a5 tempest-SnapshotsActionsTest-375113023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-261364e0-a1bd-445a-93cd-88ea053c65cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 11:51:25 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9c0112-5c85-4b31-a302-96410c1f3eb9]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:51:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-690e2444-9e05-414f-833b-8ad7f29800a5 tempest-SnapshotsActionsTest-375113023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-690e2444-9e05-414f-833b-8ad7f29800a5 tempest-SnapshotsActionsTest-375113023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb" returned: 0 in 0.902s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-690e2444-9e05-414f-833b-8ad7f29800a5 tempest-SnapshotsActionsTest-375113023 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-690e2444-9e05-414f-833b-8ad7f29800a5 tempest-SnapshotsActionsTest-375113023 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe" returned: 0 in 0.374s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-690e2444-9e05-414f-833b-8ad7f29800a5 tempest-SnapshotsActionsTest-375113023 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-690e2444-9e05-414f-833b-8ad7f29800a5 tempest-SnapshotsActionsTest-375113023 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb.1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe" returned: 0 in 0.218s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:27 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-690e2444-9e05-414f-833b-8ad7f29800a5 tempest-SnapshotsActionsTest-375113023 None] Lock "cinder-quobyte-1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe" released by "_delete_snapshot" :: held 2.945s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:51:27 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-690e2444-9e05-414f-833b-8ad7f29800a5 tempest-SnapshotsActionsTest-375113023 None] Lock "cinder-quobyte-261364e0-a1bd-445a-93cd-88ea053c65cb" released by "delete_snapshot" :: held 2.986s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:51:28 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-690e2444-9e05-414f-833b-8ad7f29800a5 tempest-SnapshotsActionsTest-375113023 None] Created reservations ['2c60f32e-64f1-4b00-b71c-815efc7fdc3f', 'c7730416-21a6-4934-a89d-1eeddcf6d1d3', '4bd14da2-952b-4852-8272-7439b6455e3d', 'a90fd461-f4c6-4723-91e5-e9fc7c582199'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:51:28 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-690e2444-9e05-414f-833b-8ad7f29800a5 tempest-SnapshotsActionsTest-375113023 None] Delete snapshot completed successfully.
Sep 18 11:51:28 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-690e2444-9e05-414f-833b-8ad7f29800a5 tempest-SnapshotsActionsTest-375113023 None] Lock "cinder-1d0f9b5c-0956-44fa-a6cf-9a227e9fc3fe-delete_snapshot" released by "delete_snapshot" :: held 3.830s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:51:29 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-fb5a8a68-c207-47d8-bffd-08497b4a63ab tempest-SnapshotsActionsTest-375113023 None] Acquiring lock "cinder-261364e0-a1bd-445a-93cd-88ea053c65cb-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:51:29 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-fb5a8a68-c207-47d8-bffd-08497b4a63ab tempest-SnapshotsActionsTest-375113023 None] Lock "cinder-261364e0-a1bd-445a-93cd-88ea053c65cb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:51:29 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-fb5a8a68-c207-47d8-bffd-08497b4a63ab tempest-SnapshotsActionsTest-375113023 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:51:29 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-fb5a8a68-c207-47d8-bffd-08497b4a63ab tempest-SnapshotsActionsTest-375113023 None] Acquiring lock "cinder-quobyte-261364e0-a1bd-445a-93cd-88ea053c65cb" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:51:29 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-fb5a8a68-c207-47d8-bffd-08497b4a63ab tempest-SnapshotsActionsTest-375113023 None] Lock "cinder-quobyte-261364e0-a1bd-445a-93cd-88ea053c65cb" acquired by "delete_volume" :: waited 0.012s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:51:29 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3f54ba-cd19-42a9-a0e7-55c883016991]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:51:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fb5a8a68-c207-47d8-bffd-08497b4a63ab tempest-SnapshotsActionsTest-375113023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fb5a8a68-c207-47d8-bffd-08497b4a63ab tempest-SnapshotsActionsTest-375113023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb" returned: 0 in 0.599s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fb5a8a68-c207-47d8-bffd-08497b4a63ab tempest-SnapshotsActionsTest-375113023 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fb5a8a68-c207-47d8-bffd-08497b4a63ab tempest-SnapshotsActionsTest-375113023 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-261364e0-a1bd-445a-93cd-88ea053c65cb" returned: 0 in 0.102s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:30 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-fb5a8a68-c207-47d8-bffd-08497b4a63ab tempest-SnapshotsActionsTest-375113023 None] Lock "cinder-quobyte-261364e0-a1bd-445a-93cd-88ea053c65cb" released by "delete_volume" :: held 0.903s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:51:31 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-fb5a8a68-c207-47d8-bffd-08497b4a63ab tempest-SnapshotsActionsTest-375113023 None] Created reservations ['76e8a69f-7f5a-4ac5-9beb-bbd6491d5123', '15514bd0-c75e-403a-b662-d87af4e9ce71', '22127f97-a3e2-4e21-8a06-da41f561a721', 'ea642bd6-d6f0-451f-8fe5-9e5bbbebe864'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:51:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-fb5a8a68-c207-47d8-bffd-08497b4a63ab tempest-SnapshotsActionsTest-375113023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:51:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-fb5a8a68-c207-47d8-bffd-08497b4a63ab tempest-SnapshotsActionsTest-375113023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:51:31 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-fb5a8a68-c207-47d8-bffd-08497b4a63ab tempest-SnapshotsActionsTest-375113023 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:51:31 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-fb5a8a68-c207-47d8-bffd-08497b4a63ab tempest-SnapshotsActionsTest-375113023 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:51:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-fb5a8a68-c207-47d8-bffd-08497b4a63ab tempest-SnapshotsActionsTest-375113023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:51:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fb5a8a68-c207-47d8-bffd-08497b4a63ab tempest-SnapshotsActionsTest-375113023 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fb5a8a68-c207-47d8-bffd-08497b4a63ab tempest-SnapshotsActionsTest-375113023 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.235s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:31 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-fb5a8a68-c207-47d8-bffd-08497b4a63ab tempest-SnapshotsActionsTest-375113023 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:51:31 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-fb5a8a68-c207-47d8-bffd-08497b4a63ab tempest-SnapshotsActionsTest-375113023 None] Deleted volume successfully.
Sep 18 11:51:31 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-fb5a8a68-c207-47d8-bffd-08497b4a63ab tempest-SnapshotsActionsTest-375113023 None] Lock "cinder-261364e0-a1bd-445a-93cd-88ea053c65cb-delete_volume" released by "delete_volume" :: held 2.235s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:51:41 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:DELETE=1,cinder:SELECT=12,cinder:INSERT=9,cinder:UPDATE=14 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:51:41 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=16,cinder:UPDATE=24,cinder:INSERT=3,cinder:DELETE=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:51:48 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-ddc64861-5ee9-40cd-af54-c69b5d70a7af tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:51:48 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddc64861-5ee9-40cd-af54-c69b5d70a7af tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:51:48 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ddc64861-5ee9-40cd-af54-c69b5d70a7af tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Flow 'volume_create_manager' (f253c77d-1855-4c1b-ba1b-da38868dad7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:51:48 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ddc64861-5ee9-40cd-af54-c69b5d70a7af tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b1eee0a-f610-4e9b-b304-deef4af96be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:51:48 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ddc64861-5ee9-40cd-af54-c69b5d70a7af tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b1eee0a-f610-4e9b-b304-deef4af96be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1541479053',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47f8d3ff-22c9-425c-b3b8-a5d2870efdaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab2df68ed4e240b5b196296aecdfd06b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:51:48Z,use_quota=True,user_id='a7f6b05b36ea4855a04d35f79b78ceb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5c2034d-ad70-4763-8f77-ad0e382e8a49),volume_type_id=f5c2034d-ad70-4763-8f77-ad0e382e8a49)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:51:48 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ddc64861-5ee9-40cd-af54-c69b5d70a7af tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18b5903a-352e-4124-aa52-eec6e3b80667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:51:48 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ddc64861-5ee9-40cd-af54-c69b5d70a7af tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18b5903a-352e-4124-aa52-eec6e3b80667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:51:48 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ddc64861-5ee9-40cd-af54-c69b5d70a7af tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d55a420-90b6-4412-a8d8-322b77d21e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:51:48 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ddc64861-5ee9-40cd-af54-c69b5d70a7af tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d55a420-90b6-4412-a8d8-322b77d21e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47f8d3ff-22c9-425c-b3b8-a5d2870efdaa', 'volume_name': 'volume-47f8d3ff-22c9-425c-b3b8-a5d2870efdaa', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:51:48 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ddc64861-5ee9-40cd-af54-c69b5d70a7af tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c46e7584-63fb-4236-8bce-d02998215251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:51:48 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ddc64861-5ee9-40cd-af54-c69b5d70a7af tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c46e7584-63fb-4236-8bce-d02998215251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:51:48 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ddc64861-5ee9-40cd-af54-c69b5d70a7af tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d3cc6ca-aa68-41a7-ba73-0bc830285f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:51:48 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-ddc64861-5ee9-40cd-af54-c69b5d70a7af tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Volume 47f8d3ff-22c9-425c-b3b8-a5d2870efdaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47f8d3ff-22c9-425c-b3b8-a5d2870efdaa', 'volume_size': 1}
Sep 18 11:51:48 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ddc64861-5ee9-40cd-af54-c69b5d70a7af tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:51:48 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ddc64861-5ee9-40cd-af54-c69b5d70a7af tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:51:48 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-ddc64861-5ee9-40cd-af54-c69b5d70a7af tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1541479053',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47f8d3ff-22c9-425c-b3b8-a5d2870efdaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab2df68ed4e240b5b196296aecdfd06b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:51:48Z,use_quota=True,user_id='a7f6b05b36ea4855a04d35f79b78ceb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5c2034d-ad70-4763-8f77-ad0e382e8a49),volume_type_id=f5c2034d-ad70-4763-8f77-ad0e382e8a49)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:51:48 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-ddc64861-5ee9-40cd-af54-c69b5d70a7af tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Creating volume 47f8d3ff-22c9-425c-b3b8-a5d2870efdaa {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:51:48 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ddc64861-5ee9-40cd-af54-c69b5d70a7af tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:51:48 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ddc64861-5ee9-40cd-af54-c69b5d70a7af tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:51:48 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-ddc64861-5ee9-40cd-af54-c69b5d70a7af tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:51:48 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-ddc64861-5ee9-40cd-af54-c69b5d70a7af tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:51:48 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ddc64861-5ee9-40cd-af54-c69b5d70a7af tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:51:48 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-ddc64861-5ee9-40cd-af54-c69b5d70a7af tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:51:48 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-ddc64861-5ee9-40cd-af54-c69b5d70a7af tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:51:48 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ddc64861-5ee9-40cd-af54-c69b5d70a7af tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-47f8d3ff-22c9-425c-b3b8-a5d2870efdaa 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:49 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=87, name=volume-47f8d3ff-22c9-425c-b3b8-a5d2870efdaa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:51:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ddc64861-5ee9-40cd-af54-c69b5d70a7af tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-47f8d3ff-22c9-425c-b3b8-a5d2870efdaa 1073741824" returned: 0 in 0.542s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ddc64861-5ee9-40cd-af54-c69b5d70a7af tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-47f8d3ff-22c9-425c-b3b8-a5d2870efdaa {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ddc64861-5ee9-40cd-af54-c69b5d70a7af tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-47f8d3ff-22c9-425c-b3b8-a5d2870efdaa" returned: 0 in 0.322s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:49 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-ddc64861-5ee9-40cd-af54-c69b5d70a7af tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] <== create_volume: return (1016ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:51:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ddc64861-5ee9-40cd-af54-c69b5d70a7af tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:51:49 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-ce3e8586-3650-4c56-a858-f9cb0e797841 tempest-VolumesActionsTest-1487175399 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:51:49 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce3e8586-3650-4c56-a858-f9cb0e797841 tempest-VolumesActionsTest-1487175399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:51:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ce3e8586-3650-4c56-a858-f9cb0e797841 tempest-VolumesActionsTest-1487175399 None] Flow 'volume_create_manager' (406aa373-1386-4d61-85e2-2749ad00d574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:51:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ce3e8586-3650-4c56-a858-f9cb0e797841 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64637eef-1df5-469d-a732-8c4bddbdecd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:51:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ce3e8586-3650-4c56-a858-f9cb0e797841 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64637eef-1df5-469d-a732-8c4bddbdecd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-698616082',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd12bca2-ec24-46dd-b31c-15b9085ee221,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='816bb0773bbd483d9b38b40ac8e0ea00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:51:49Z,use_quota=True,user_id='e3b9e62a6be74a13a4ddefaae9f375de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:51:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ce3e8586-3650-4c56-a858-f9cb0e797841 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0f882db-ad04-4d88-bc18-1a3ad6727b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:51:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ce3e8586-3650-4c56-a858-f9cb0e797841 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0f882db-ad04-4d88-bc18-1a3ad6727b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:51:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ce3e8586-3650-4c56-a858-f9cb0e797841 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c7114b7-6b68-4de0-8d7f-0a6f4d26f79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:51:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ce3e8586-3650-4c56-a858-f9cb0e797841 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c7114b7-6b68-4de0-8d7f-0a6f4d26f79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd12bca2-ec24-46dd-b31c-15b9085ee221', 'volume_name': 'volume-fd12bca2-ec24-46dd-b31c-15b9085ee221', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:51:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ce3e8586-3650-4c56-a858-f9cb0e797841 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd746900-c280-4467-a744-89711caff657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:51:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ce3e8586-3650-4c56-a858-f9cb0e797841 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd746900-c280-4467-a744-89711caff657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:51:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ce3e8586-3650-4c56-a858-f9cb0e797841 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d889ed95-375f-4d12-bf9b-86e633838e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:51:50 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-ce3e8586-3650-4c56-a858-f9cb0e797841 tempest-VolumesActionsTest-1487175399 None] Volume fd12bca2-ec24-46dd-b31c-15b9085ee221: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd12bca2-ec24-46dd-b31c-15b9085ee221', 'volume_size': 1}
Sep 18 11:51:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ce3e8586-3650-4c56-a858-f9cb0e797841 tempest-VolumesActionsTest-1487175399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:51:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ce3e8586-3650-4c56-a858-f9cb0e797841 tempest-VolumesActionsTest-1487175399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:51:50 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-ce3e8586-3650-4c56-a858-f9cb0e797841 tempest-VolumesActionsTest-1487175399 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-698616082',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd12bca2-ec24-46dd-b31c-15b9085ee221,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='816bb0773bbd483d9b38b40ac8e0ea00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:51:49Z,use_quota=True,user_id='e3b9e62a6be74a13a4ddefaae9f375de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:51:50 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-ce3e8586-3650-4c56-a858-f9cb0e797841 tempest-VolumesActionsTest-1487175399 None] Creating volume fd12bca2-ec24-46dd-b31c-15b9085ee221 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:51:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ce3e8586-3650-4c56-a858-f9cb0e797841 tempest-VolumesActionsTest-1487175399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:51:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ce3e8586-3650-4c56-a858-f9cb0e797841 tempest-VolumesActionsTest-1487175399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:51:50 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-ce3e8586-3650-4c56-a858-f9cb0e797841 tempest-VolumesActionsTest-1487175399 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:51:50 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-ce3e8586-3650-4c56-a858-f9cb0e797841 tempest-VolumesActionsTest-1487175399 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:51:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ce3e8586-3650-4c56-a858-f9cb0e797841 tempest-VolumesActionsTest-1487175399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:51:50 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-ce3e8586-3650-4c56-a858-f9cb0e797841 tempest-VolumesActionsTest-1487175399 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:51:50 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-ce3e8586-3650-4c56-a858-f9cb0e797841 tempest-VolumesActionsTest-1487175399 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:51:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ce3e8586-3650-4c56-a858-f9cb0e797841 tempest-VolumesActionsTest-1487175399 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-fd12bca2-ec24-46dd-b31c-15b9085ee221 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ddc64861-5ee9-40cd-af54-c69b5d70a7af tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d3cc6ca-aa68-41a7-ba73-0bc830285f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47f8d3ff-22c9-425c-b3b8-a5d2870efdaa', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:51:50 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=88, name=volume-fd12bca2-ec24-46dd-b31c-15b9085ee221, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:51:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ddc64861-5ee9-40cd-af54-c69b5d70a7af tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d63a9158-b6b3-464c-9002-a995b2e37a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:51:50 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-ddc64861-5ee9-40cd-af54-c69b5d70a7af tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Volume volume-47f8d3ff-22c9-425c-b3b8-a5d2870efdaa (47f8d3ff-22c9-425c-b3b8-a5d2870efdaa): created successfully
Sep 18 11:51:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ddc64861-5ee9-40cd-af54-c69b5d70a7af tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d63a9158-b6b3-464c-9002-a995b2e37a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:51:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ddc64861-5ee9-40cd-af54-c69b5d70a7af tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Flow 'volume_create_manager' (f253c77d-1855-4c1b-ba1b-da38868dad7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:51:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ce3e8586-3650-4c56-a858-f9cb0e797841 tempest-VolumesActionsTest-1487175399 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-fd12bca2-ec24-46dd-b31c-15b9085ee221 1073741824" returned: 0 in 0.523s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ce3e8586-3650-4c56-a858-f9cb0e797841 tempest-VolumesActionsTest-1487175399 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-fd12bca2-ec24-46dd-b31c-15b9085ee221 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:50 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-ddc64861-5ee9-40cd-af54-c69b5d70a7af tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Created volume successfully.
Sep 18 11:51:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ce3e8586-3650-4c56-a858-f9cb0e797841 tempest-VolumesActionsTest-1487175399 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-fd12bca2-ec24-46dd-b31c-15b9085ee221" returned: 0 in 0.269s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:50 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-ce3e8586-3650-4c56-a858-f9cb0e797841 tempest-VolumesActionsTest-1487175399 None] <== create_volume: return (818ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:51:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ce3e8586-3650-4c56-a858-f9cb0e797841 tempest-VolumesActionsTest-1487175399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:51:51 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ce3e8586-3650-4c56-a858-f9cb0e797841 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d889ed95-375f-4d12-bf9b-86e633838e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd12bca2-ec24-46dd-b31c-15b9085ee221', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:51:51 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ce3e8586-3650-4c56-a858-f9cb0e797841 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66547c68-10f2-4ba1-aa2a-f3c67c0d3b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:51:51 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-ce3e8586-3650-4c56-a858-f9cb0e797841 tempest-VolumesActionsTest-1487175399 None] Volume volume-fd12bca2-ec24-46dd-b31c-15b9085ee221 (fd12bca2-ec24-46dd-b31c-15b9085ee221): created successfully
Sep 18 11:51:51 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ce3e8586-3650-4c56-a858-f9cb0e797841 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66547c68-10f2-4ba1-aa2a-f3c67c0d3b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:51:51 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ce3e8586-3650-4c56-a858-f9cb0e797841 tempest-VolumesActionsTest-1487175399 None] Flow 'volume_create_manager' (406aa373-1386-4d61-85e2-2749ad00d574) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:51:51 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-ce3e8586-3650-4c56-a858-f9cb0e797841 tempest-VolumesActionsTest-1487175399 None] Created volume successfully.
Sep 18 11:51:51 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-d9167ac7-f1a5-4fbc-a7f9-923673b6ddf9 tempest-VolumesActionsTest-1487175399 None] Acquiring lock "cinder-fd12bca2-ec24-46dd-b31c-15b9085ee221" by "attach_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:51:51 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-d9167ac7-f1a5-4fbc-a7f9-923673b6ddf9 tempest-VolumesActionsTest-1487175399 None] Lock "cinder-fd12bca2-ec24-46dd-b31c-15b9085ee221" acquired by "attach_volume" :: waited 0.058s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:51:52 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-d9167ac7-f1a5-4fbc-a7f9-923673b6ddf9 tempest-VolumesActionsTest-1487175399 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:51:52 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-d9167ac7-f1a5-4fbc-a7f9-923673b6ddf9 tempest-VolumesActionsTest-1487175399 None] Attaching volume fd12bca2-ec24-46dd-b31c-15b9085ee221 to instance b7178c92-fe09-46eb-95ff-a4b1cc7e3558 at mountpoint /dev/vdb on host None.
Sep 18 11:51:52 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-20800c16-b0c6-4ca6-ab1e-f4d11555bed6 tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:51:52 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-d9167ac7-f1a5-4fbc-a7f9-923673b6ddf9 tempest-VolumesActionsTest-1487175399 None] Attach volume completed successfully.
Sep 18 11:51:52 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-d9167ac7-f1a5-4fbc-a7f9-923673b6ddf9 tempest-VolumesActionsTest-1487175399 None] Lock "cinder-fd12bca2-ec24-46dd-b31c-15b9085ee221" released by "attach_volume" :: held 0.472s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:51:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-20800c16-b0c6-4ca6-ab1e-f4d11555bed6 tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:51:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-20800c16-b0c6-4ca6-ab1e-f4d11555bed6 tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:51:52 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-20800c16-b0c6-4ca6-ab1e-f4d11555bed6 tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:51:52 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-20800c16-b0c6-4ca6-ab1e-f4d11555bed6 tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:51:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-20800c16-b0c6-4ca6-ab1e-f4d11555bed6 tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:51:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-20800c16-b0c6-4ca6-ab1e-f4d11555bed6 tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-20800c16-b0c6-4ca6-ab1e-f4d11555bed6 tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.134s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:52 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-20800c16-b0c6-4ca6-ab1e-f4d11555bed6 tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:51:52 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-20800c16-b0c6-4ca6-ab1e-f4d11555bed6 tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Retype volume completed successfully.
Sep 18 11:51:53 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-0d2abe3f-7c85-4077-9279-4281d64f4a2f tempest-VolumesActionsTest-740651357 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:51:53 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-0d2abe3f-7c85-4077-9279-4281d64f4a2f tempest-VolumesActionsTest-740651357 None] Terminate volume connection completed successfully.
Sep 18 11:51:53 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4693c503-2120-4ae6-bbf7-c773faa9448e tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Acquiring lock "cinder-47f8d3ff-22c9-425c-b3b8-a5d2870efdaa-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:51:53 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4693c503-2120-4ae6-bbf7-c773faa9448e tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Lock "cinder-47f8d3ff-22c9-425c-b3b8-a5d2870efdaa-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:51:53 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0d2abe3f-7c85-4077-9279-4281d64f4a2f tempest-VolumesActionsTest-740651357 None] Acquiring lock "cinder-fd12bca2-ec24-46dd-b31c-15b9085ee221-detach_volume" by "detach_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:51:53 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0d2abe3f-7c85-4077-9279-4281d64f4a2f tempest-VolumesActionsTest-740651357 None] Lock "cinder-fd12bca2-ec24-46dd-b31c-15b9085ee221-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:51:53 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-4693c503-2120-4ae6-bbf7-c773faa9448e tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:51:53 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4693c503-2120-4ae6-bbf7-c773faa9448e tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Acquiring lock "cinder-quobyte-47f8d3ff-22c9-425c-b3b8-a5d2870efdaa" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:51:54 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-0d2abe3f-7c85-4077-9279-4281d64f4a2f tempest-VolumesActionsTest-740651357 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:51:54 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-0d2abe3f-7c85-4077-9279-4281d64f4a2f tempest-VolumesActionsTest-740651357 None] Detaching volume fd12bca2-ec24-46dd-b31c-15b9085ee221 from instance b7178c92-fe09-46eb-95ff-a4b1cc7e3558.
Sep 18 11:51:54 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-0d2abe3f-7c85-4077-9279-4281d64f4a2f tempest-VolumesActionsTest-740651357 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:51:54 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4693c503-2120-4ae6-bbf7-c773faa9448e tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Lock "cinder-quobyte-47f8d3ff-22c9-425c-b3b8-a5d2870efdaa" acquired by "delete_volume" :: waited 0.056s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:51:54 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5083be4-a677-4ac6-8ed8-0b771f24e7c7]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:51:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4693c503-2120-4ae6-bbf7-c773faa9448e tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-47f8d3ff-22c9-425c-b3b8-a5d2870efdaa {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:54 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-0d2abe3f-7c85-4077-9279-4281d64f4a2f tempest-VolumesActionsTest-740651357 None] Detach volume completed successfully.
Sep 18 11:51:54 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0d2abe3f-7c85-4077-9279-4281d64f4a2f tempest-VolumesActionsTest-740651357 None] Lock "cinder-fd12bca2-ec24-46dd-b31c-15b9085ee221-detach_volume" released by "detach_volume" :: held 0.670s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:51:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4693c503-2120-4ae6-bbf7-c773faa9448e tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-47f8d3ff-22c9-425c-b3b8-a5d2870efdaa" returned: 0 in 0.654s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4693c503-2120-4ae6-bbf7-c773faa9448e tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-47f8d3ff-22c9-425c-b3b8-a5d2870efdaa {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4693c503-2120-4ae6-bbf7-c773faa9448e tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-47f8d3ff-22c9-425c-b3b8-a5d2870efdaa" returned: 0 in 0.155s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:55 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4693c503-2120-4ae6-bbf7-c773faa9448e tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Lock "cinder-quobyte-47f8d3ff-22c9-425c-b3b8-a5d2870efdaa" released by "delete_volume" :: held 1.018s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:51:55 devstack cinder-volume[83176]: WARNING cinder.quota [None req-4693c503-2120-4ae6-bbf7-c773faa9448e tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 18 11:51:55 devstack cinder-volume[83176]: WARNING cinder.quota [None req-4693c503-2120-4ae6-bbf7-c773faa9448e tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 18 11:51:55 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-105546b0-d0c5-4086-aa73-7369df9bb841 tempest-VolumesActionsTest-1487175399 None] Acquiring lock "cinder-fd12bca2-ec24-46dd-b31c-15b9085ee221-detach_volume" by "detach_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:51:55 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-105546b0-d0c5-4086-aa73-7369df9bb841 tempest-VolumesActionsTest-1487175399 None] Lock "cinder-fd12bca2-ec24-46dd-b31c-15b9085ee221-detach_volume" acquired by "detach_volume" :: waited 0.049s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:51:55 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-105546b0-d0c5-4086-aa73-7369df9bb841 tempest-VolumesActionsTest-1487175399 None] Volume detach called, but volume not attached.
Sep 18 11:51:55 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-4693c503-2120-4ae6-bbf7-c773faa9448e tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Created reservations ['5ec12313-8a14-4d98-901e-e514ffdde759', 'df34540f-b7a9-4471-b52c-7e60976a2d65', 'd264a1cb-6d87-451c-86b7-3ffca5d92c99', '01c7ede1-c4ba-4910-bb9b-676106fde51c'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:51:55 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-105546b0-d0c5-4086-aa73-7369df9bb841 tempest-VolumesActionsTest-1487175399 None] Lock "cinder-fd12bca2-ec24-46dd-b31c-15b9085ee221-detach_volume" released by "detach_volume" :: held 0.085s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:51:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4693c503-2120-4ae6-bbf7-c773faa9448e tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:51:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4693c503-2120-4ae6-bbf7-c773faa9448e tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:51:55 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-4693c503-2120-4ae6-bbf7-c773faa9448e tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:51:55 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-4693c503-2120-4ae6-bbf7-c773faa9448e tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:51:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4693c503-2120-4ae6-bbf7-c773faa9448e tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:51:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4693c503-2120-4ae6-bbf7-c773faa9448e tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4693c503-2120-4ae6-bbf7-c773faa9448e tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.131s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:55 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-4693c503-2120-4ae6-bbf7-c773faa9448e tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:51:55 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-4693c503-2120-4ae6-bbf7-c773faa9448e tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Deleted volume successfully.
Sep 18 11:51:56 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4693c503-2120-4ae6-bbf7-c773faa9448e tempest-VolumeRetypeWithoutMigrationTest-1066805097 None] Lock "cinder-47f8d3ff-22c9-425c-b3b8-a5d2870efdaa-delete_volume" released by "delete_volume" :: held 2.166s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:51:56 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-30f35fc9-ed63-421a-bf8e-fd9ad4c66c6d tempest-VolumesActionsTest-1487175399 None] Acquiring lock "cinder-fd12bca2-ec24-46dd-b31c-15b9085ee221-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:51:56 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-30f35fc9-ed63-421a-bf8e-fd9ad4c66c6d tempest-VolumesActionsTest-1487175399 None] Lock "cinder-fd12bca2-ec24-46dd-b31c-15b9085ee221-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:51:56 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-30f35fc9-ed63-421a-bf8e-fd9ad4c66c6d tempest-VolumesActionsTest-1487175399 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:51:56 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-30f35fc9-ed63-421a-bf8e-fd9ad4c66c6d tempest-VolumesActionsTest-1487175399 None] Acquiring lock "cinder-quobyte-fd12bca2-ec24-46dd-b31c-15b9085ee221" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:51:56 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-30f35fc9-ed63-421a-bf8e-fd9ad4c66c6d tempest-VolumesActionsTest-1487175399 None] Lock "cinder-quobyte-fd12bca2-ec24-46dd-b31c-15b9085ee221" acquired by "delete_volume" :: waited 0.037s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:51:56 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7537420a-8714-4590-8ac1-cc4858f87efe]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:51:56 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-30f35fc9-ed63-421a-bf8e-fd9ad4c66c6d tempest-VolumesActionsTest-1487175399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-fd12bca2-ec24-46dd-b31c-15b9085ee221 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:57 devstack quobyte-client[83193]: System call of process 94624 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:51:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-30f35fc9-ed63-421a-bf8e-fd9ad4c66c6d tempest-VolumesActionsTest-1487175399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-fd12bca2-ec24-46dd-b31c-15b9085ee221" returned: 0 in 0.766s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-30f35fc9-ed63-421a-bf8e-fd9ad4c66c6d tempest-VolumesActionsTest-1487175399 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-fd12bca2-ec24-46dd-b31c-15b9085ee221 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-30f35fc9-ed63-421a-bf8e-fd9ad4c66c6d tempest-VolumesActionsTest-1487175399 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-fd12bca2-ec24-46dd-b31c-15b9085ee221" returned: 0 in 0.257s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:58 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-30f35fc9-ed63-421a-bf8e-fd9ad4c66c6d tempest-VolumesActionsTest-1487175399 None] Lock "cinder-quobyte-fd12bca2-ec24-46dd-b31c-15b9085ee221" released by "delete_volume" :: held 1.579s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:51:58 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-30f35fc9-ed63-421a-bf8e-fd9ad4c66c6d tempest-VolumesActionsTest-1487175399 None] Created reservations ['53dd0ae9-7496-411b-888f-3d1aaa6011d8', '2560d605-5acd-48e9-953b-158dcee22c9d', '627c342c-f54a-4a35-9b9e-6052a5a8be63', 'cdbbbfe8-26e0-4a7d-88b3-14c016e72a40'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:51:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-30f35fc9-ed63-421a-bf8e-fd9ad4c66c6d tempest-VolumesActionsTest-1487175399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:51:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-30f35fc9-ed63-421a-bf8e-fd9ad4c66c6d tempest-VolumesActionsTest-1487175399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:51:58 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-30f35fc9-ed63-421a-bf8e-fd9ad4c66c6d tempest-VolumesActionsTest-1487175399 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:51:58 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-30f35fc9-ed63-421a-bf8e-fd9ad4c66c6d tempest-VolumesActionsTest-1487175399 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:51:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-30f35fc9-ed63-421a-bf8e-fd9ad4c66c6d tempest-VolumesActionsTest-1487175399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:51:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-30f35fc9-ed63-421a-bf8e-fd9ad4c66c6d tempest-VolumesActionsTest-1487175399 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:51:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-30f35fc9-ed63-421a-bf8e-fd9ad4c66c6d tempest-VolumesActionsTest-1487175399 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.213s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:51:59 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-30f35fc9-ed63-421a-bf8e-fd9ad4c66c6d tempest-VolumesActionsTest-1487175399 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:51:59 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-30f35fc9-ed63-421a-bf8e-fd9ad4c66c6d tempest-VolumesActionsTest-1487175399 None] Deleted volume successfully.
Sep 18 11:51:59 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-30f35fc9-ed63-421a-bf8e-fd9ad4c66c6d tempest-VolumesActionsTest-1487175399 None] Lock "cinder-fd12bca2-ec24-46dd-b31c-15b9085ee221-delete_volume" released by "delete_volume" :: held 3.173s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:52:08 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:UPDATE=34,cinder:SELECT=21,cinder:INSERT=3 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:52:09 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=32,cinder:DELETE=4,cinder:UPDATE=22,cinder:INSERT=7 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:52:09 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-11a598f8-af6d-45a5-bd50-b6314c116a16 tempest-VolumesActionsTest-1487175399 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:52:09 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-11a598f8-af6d-45a5-bd50-b6314c116a16 tempest-VolumesActionsTest-1487175399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:52:09 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-11a598f8-af6d-45a5-bd50-b6314c116a16 tempest-VolumesActionsTest-1487175399 None] Flow 'volume_create_manager' (4d39e242-2540-41f4-b382-28784b70e240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:52:09 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-11a598f8-af6d-45a5-bd50-b6314c116a16 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a86773d-ffce-459b-9dea-fc4e5d6fe92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:10 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-11a598f8-af6d-45a5-bd50-b6314c116a16 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a86773d-ffce-459b-9dea-fc4e5d6fe92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2090166110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06181859-005d-4be8-8804-61f0f30a57b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='816bb0773bbd483d9b38b40ac8e0ea00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:52:10Z,use_quota=True,user_id='e3b9e62a6be74a13a4ddefaae9f375de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:10 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-11a598f8-af6d-45a5-bd50-b6314c116a16 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c59200e-fae7-4eb2-be95-e7a30f9b86e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:10 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-11a598f8-af6d-45a5-bd50-b6314c116a16 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c59200e-fae7-4eb2-be95-e7a30f9b86e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:10 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-11a598f8-af6d-45a5-bd50-b6314c116a16 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc27a93c-4304-4168-b4de-df14daeb3a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:10 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-11a598f8-af6d-45a5-bd50-b6314c116a16 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc27a93c-4304-4168-b4de-df14daeb3a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06181859-005d-4be8-8804-61f0f30a57b8', 'volume_name': 'volume-06181859-005d-4be8-8804-61f0f30a57b8', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:10 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-11a598f8-af6d-45a5-bd50-b6314c116a16 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7d198dc-b3e8-47e7-8ef7-2514434b2560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:10 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-11a598f8-af6d-45a5-bd50-b6314c116a16 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7d198dc-b3e8-47e7-8ef7-2514434b2560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:10 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-11a598f8-af6d-45a5-bd50-b6314c116a16 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd49e454-b0d9-4046-bc4a-f877e0237287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:10 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-11a598f8-af6d-45a5-bd50-b6314c116a16 tempest-VolumesActionsTest-1487175399 None] Volume 06181859-005d-4be8-8804-61f0f30a57b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06181859-005d-4be8-8804-61f0f30a57b8', 'volume_size': 1}
Sep 18 11:52:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-11a598f8-af6d-45a5-bd50-b6314c116a16 tempest-VolumesActionsTest-1487175399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:52:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-11a598f8-af6d-45a5-bd50-b6314c116a16 tempest-VolumesActionsTest-1487175399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:52:10 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-11a598f8-af6d-45a5-bd50-b6314c116a16 tempest-VolumesActionsTest-1487175399 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2090166110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06181859-005d-4be8-8804-61f0f30a57b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='816bb0773bbd483d9b38b40ac8e0ea00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:52:10Z,use_quota=True,user_id='e3b9e62a6be74a13a4ddefaae9f375de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:52:10 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-11a598f8-af6d-45a5-bd50-b6314c116a16 tempest-VolumesActionsTest-1487175399 None] Creating volume 06181859-005d-4be8-8804-61f0f30a57b8 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:52:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-11a598f8-af6d-45a5-bd50-b6314c116a16 tempest-VolumesActionsTest-1487175399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:52:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-11a598f8-af6d-45a5-bd50-b6314c116a16 tempest-VolumesActionsTest-1487175399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:52:10 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-11a598f8-af6d-45a5-bd50-b6314c116a16 tempest-VolumesActionsTest-1487175399 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:52:10 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-11a598f8-af6d-45a5-bd50-b6314c116a16 tempest-VolumesActionsTest-1487175399 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:52:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-11a598f8-af6d-45a5-bd50-b6314c116a16 tempest-VolumesActionsTest-1487175399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:52:10 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-11a598f8-af6d-45a5-bd50-b6314c116a16 tempest-VolumesActionsTest-1487175399 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:52:10 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-11a598f8-af6d-45a5-bd50-b6314c116a16 tempest-VolumesActionsTest-1487175399 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:52:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-11a598f8-af6d-45a5-bd50-b6314c116a16 tempest-VolumesActionsTest-1487175399 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-06181859-005d-4be8-8804-61f0f30a57b8 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:10 devstack quobyte-client[83193]: System call of process 94680 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:52:10 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=89, name=volume-06181859-005d-4be8-8804-61f0f30a57b8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:52:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-11a598f8-af6d-45a5-bd50-b6314c116a16 tempest-VolumesActionsTest-1487175399 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-06181859-005d-4be8-8804-61f0f30a57b8 1073741824" returned: 0 in 0.397s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-11a598f8-af6d-45a5-bd50-b6314c116a16 tempest-VolumesActionsTest-1487175399 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-06181859-005d-4be8-8804-61f0f30a57b8 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-11a598f8-af6d-45a5-bd50-b6314c116a16 tempest-VolumesActionsTest-1487175399 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-06181859-005d-4be8-8804-61f0f30a57b8" returned: 0 in 0.128s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:10 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-11a598f8-af6d-45a5-bd50-b6314c116a16 tempest-VolumesActionsTest-1487175399 None] <== create_volume: return (608ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:52:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-11a598f8-af6d-45a5-bd50-b6314c116a16 tempest-VolumesActionsTest-1487175399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.620s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:52:10 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-11a598f8-af6d-45a5-bd50-b6314c116a16 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd49e454-b0d9-4046-bc4a-f877e0237287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06181859-005d-4be8-8804-61f0f30a57b8', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:10 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-11a598f8-af6d-45a5-bd50-b6314c116a16 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cef42701-e7cb-4dd9-9167-47414b5f4f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:10 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-11a598f8-af6d-45a5-bd50-b6314c116a16 tempest-VolumesActionsTest-1487175399 None] Volume volume-06181859-005d-4be8-8804-61f0f30a57b8 (06181859-005d-4be8-8804-61f0f30a57b8): created successfully
Sep 18 11:52:10 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-11a598f8-af6d-45a5-bd50-b6314c116a16 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cef42701-e7cb-4dd9-9167-47414b5f4f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:10 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-11a598f8-af6d-45a5-bd50-b6314c116a16 tempest-VolumesActionsTest-1487175399 None] Flow 'volume_create_manager' (4d39e242-2540-41f4-b382-28784b70e240) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:52:11 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-11a598f8-af6d-45a5-bd50-b6314c116a16 tempest-VolumesActionsTest-1487175399 None] Created volume successfully.
Sep 18 11:52:12 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-9238178b-a4d4-47bf-bc17-eb0f11cc4b25 tempest-VolumesActionsTest-740651357 None] Acquiring lock "cinder-06181859-005d-4be8-8804-61f0f30a57b8-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:52:12 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-9238178b-a4d4-47bf-bc17-eb0f11cc4b25 tempest-VolumesActionsTest-740651357 None] Lock "cinder-06181859-005d-4be8-8804-61f0f30a57b8-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:52:12 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-9238178b-a4d4-47bf-bc17-eb0f11cc4b25 tempest-VolumesActionsTest-740651357 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:52:12 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-9238178b-a4d4-47bf-bc17-eb0f11cc4b25 tempest-VolumesActionsTest-740651357 None] Acquiring lock "cinder-quobyte-06181859-005d-4be8-8804-61f0f30a57b8" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:52:12 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-9238178b-a4d4-47bf-bc17-eb0f11cc4b25 tempest-VolumesActionsTest-740651357 None] Lock "cinder-quobyte-06181859-005d-4be8-8804-61f0f30a57b8" acquired by "delete_volume" :: waited 0.014s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:52:12 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2683d425-aeae-464d-8474-5d2fe5ce97fb]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:52:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9238178b-a4d4-47bf-bc17-eb0f11cc4b25 tempest-VolumesActionsTest-740651357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-06181859-005d-4be8-8804-61f0f30a57b8 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9238178b-a4d4-47bf-bc17-eb0f11cc4b25 tempest-VolumesActionsTest-740651357 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-06181859-005d-4be8-8804-61f0f30a57b8" returned: 0 in 0.456s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9238178b-a4d4-47bf-bc17-eb0f11cc4b25 tempest-VolumesActionsTest-740651357 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-06181859-005d-4be8-8804-61f0f30a57b8 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9238178b-a4d4-47bf-bc17-eb0f11cc4b25 tempest-VolumesActionsTest-740651357 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-06181859-005d-4be8-8804-61f0f30a57b8" returned: 0 in 0.110s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:13 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-9238178b-a4d4-47bf-bc17-eb0f11cc4b25 tempest-VolumesActionsTest-740651357 None] Lock "cinder-quobyte-06181859-005d-4be8-8804-61f0f30a57b8" released by "delete_volume" :: held 0.726s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:52:13 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-8be8369c-0a7b-42ea-92f8-f7ff20617bfd tempest-VolumeTypesAccessTest-1959282284 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:52:13 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-8be8369c-0a7b-42ea-92f8-f7ff20617bfd tempest-VolumeTypesAccessTest-1959282284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:52:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8be8369c-0a7b-42ea-92f8-f7ff20617bfd tempest-VolumeTypesAccessTest-1959282284 None] Flow 'volume_create_manager' (2d3a8e09-1f24-4ef1-b244-bce308e2668d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:52:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8be8369c-0a7b-42ea-92f8-f7ff20617bfd tempest-VolumeTypesAccessTest-1959282284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5ac8b13-9dc5-47d2-a59c-b5a9076747ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:13 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-9238178b-a4d4-47bf-bc17-eb0f11cc4b25 tempest-VolumesActionsTest-740651357 None] Created reservations ['0fbd5656-f3f9-4b94-931f-755a47145d0c', 'ae8c0047-0344-4ab4-91be-82018d38633a', 'cd9672c3-3f72-4046-8dd9-68944eaed148', 'b7b6dab7-99fb-4c0f-ae8a-09a2d0bdc75b'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:52:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8be8369c-0a7b-42ea-92f8-f7ff20617bfd tempest-VolumeTypesAccessTest-1959282284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5ac8b13-9dc5-47d2-a59c-b5a9076747ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1913571578',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34549bf2-b4a3-45fe-af96-484a64801bc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00941ed79bfd4fa1ac49475ed4ead6e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:52:13Z,use_quota=True,user_id='a5504454ca8c4e7abe87414aed4f25b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(addcc3a4-8421-414d-92fd-d06417c7252f),volume_type_id=addcc3a4-8421-414d-92fd-d06417c7252f)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8be8369c-0a7b-42ea-92f8-f7ff20617bfd tempest-VolumeTypesAccessTest-1959282284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22caf2b3-df3d-4502-8687-468b08e27f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8be8369c-0a7b-42ea-92f8-f7ff20617bfd tempest-VolumeTypesAccessTest-1959282284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22caf2b3-df3d-4502-8687-468b08e27f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8be8369c-0a7b-42ea-92f8-f7ff20617bfd tempest-VolumeTypesAccessTest-1959282284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca450d90-af56-46a1-a93d-677a44ed44d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8be8369c-0a7b-42ea-92f8-f7ff20617bfd tempest-VolumeTypesAccessTest-1959282284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca450d90-af56-46a1-a93d-677a44ed44d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34549bf2-b4a3-45fe-af96-484a64801bc9', 'volume_name': 'volume-34549bf2-b4a3-45fe-af96-484a64801bc9', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8be8369c-0a7b-42ea-92f8-f7ff20617bfd tempest-VolumeTypesAccessTest-1959282284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6a760f5-661c-428e-8e26-de49978e162f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8be8369c-0a7b-42ea-92f8-f7ff20617bfd tempest-VolumeTypesAccessTest-1959282284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6a760f5-661c-428e-8e26-de49978e162f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8be8369c-0a7b-42ea-92f8-f7ff20617bfd tempest-VolumeTypesAccessTest-1959282284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fe3582e-5329-448e-900b-14dada1b89fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:13 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-8be8369c-0a7b-42ea-92f8-f7ff20617bfd tempest-VolumeTypesAccessTest-1959282284 None] Volume 34549bf2-b4a3-45fe-af96-484a64801bc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34549bf2-b4a3-45fe-af96-484a64801bc9', 'volume_size': 1}
Sep 18 11:52:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-8be8369c-0a7b-42ea-92f8-f7ff20617bfd tempest-VolumeTypesAccessTest-1959282284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:52:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-8be8369c-0a7b-42ea-92f8-f7ff20617bfd tempest-VolumeTypesAccessTest-1959282284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:52:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-8be8369c-0a7b-42ea-92f8-f7ff20617bfd tempest-VolumeTypesAccessTest-1959282284 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1913571578',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34549bf2-b4a3-45fe-af96-484a64801bc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00941ed79bfd4fa1ac49475ed4ead6e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:52:13Z,use_quota=True,user_id='a5504454ca8c4e7abe87414aed4f25b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(addcc3a4-8421-414d-92fd-d06417c7252f),volume_type_id=addcc3a4-8421-414d-92fd-d06417c7252f)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:52:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-8be8369c-0a7b-42ea-92f8-f7ff20617bfd tempest-VolumeTypesAccessTest-1959282284 None] Creating volume 34549bf2-b4a3-45fe-af96-484a64801bc9 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:52:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-8be8369c-0a7b-42ea-92f8-f7ff20617bfd tempest-VolumeTypesAccessTest-1959282284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:52:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-8be8369c-0a7b-42ea-92f8-f7ff20617bfd tempest-VolumeTypesAccessTest-1959282284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:52:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-8be8369c-0a7b-42ea-92f8-f7ff20617bfd tempest-VolumeTypesAccessTest-1959282284 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:52:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-8be8369c-0a7b-42ea-92f8-f7ff20617bfd tempest-VolumeTypesAccessTest-1959282284 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:52:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-8be8369c-0a7b-42ea-92f8-f7ff20617bfd tempest-VolumeTypesAccessTest-1959282284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:52:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-8be8369c-0a7b-42ea-92f8-f7ff20617bfd tempest-VolumeTypesAccessTest-1959282284 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:52:13 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-8be8369c-0a7b-42ea-92f8-f7ff20617bfd tempest-VolumeTypesAccessTest-1959282284 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:52:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8be8369c-0a7b-42ea-92f8-f7ff20617bfd tempest-VolumeTypesAccessTest-1959282284 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-34549bf2-b4a3-45fe-af96-484a64801bc9 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:13 devstack quobyte-client[83193]: System call of process 94688 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:52:13 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=90, name=volume-34549bf2-b4a3-45fe-af96-484a64801bc9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:52:13 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 11:52:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:52:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:52:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:52:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:52:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:52:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8be8369c-0a7b-42ea-92f8-f7ff20617bfd tempest-VolumeTypesAccessTest-1959282284 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-34549bf2-b4a3-45fe-af96-484a64801bc9 1073741824" returned: 0 in 0.549s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.277s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8be8369c-0a7b-42ea-92f8-f7ff20617bfd tempest-VolumeTypesAccessTest-1959282284 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-34549bf2-b4a3-45fe-af96-484a64801bc9 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:14 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:52:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8be8369c-0a7b-42ea-92f8-f7ff20617bfd tempest-VolumeTypesAccessTest-1959282284 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-34549bf2-b4a3-45fe-af96-484a64801bc9" returned: 0 in 0.391s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-8be8369c-0a7b-42ea-92f8-f7ff20617bfd tempest-VolumeTypesAccessTest-1959282284 None] <== create_volume: return (986ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:52:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-8be8369c-0a7b-42ea-92f8-f7ff20617bfd tempest-VolumeTypesAccessTest-1959282284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:52:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8be8369c-0a7b-42ea-92f8-f7ff20617bfd tempest-VolumeTypesAccessTest-1959282284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fe3582e-5329-448e-900b-14dada1b89fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34549bf2-b4a3-45fe-af96-484a64801bc9', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8be8369c-0a7b-42ea-92f8-f7ff20617bfd tempest-VolumeTypesAccessTest-1959282284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09dc3ef6-7126-4672-b2b3-322a3e79afd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-9238178b-a4d4-47bf-bc17-eb0f11cc4b25 tempest-VolumesActionsTest-740651357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:52:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-9238178b-a4d4-47bf-bc17-eb0f11cc4b25 tempest-VolumesActionsTest-740651357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:52:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-9238178b-a4d4-47bf-bc17-eb0f11cc4b25 tempest-VolumesActionsTest-740651357 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:52:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-9238178b-a4d4-47bf-bc17-eb0f11cc4b25 tempest-VolumesActionsTest-740651357 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:52:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-9238178b-a4d4-47bf-bc17-eb0f11cc4b25 tempest-VolumesActionsTest-740651357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:52:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9238178b-a4d4-47bf-bc17-eb0f11cc4b25 tempest-VolumesActionsTest-740651357 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:14 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-8be8369c-0a7b-42ea-92f8-f7ff20617bfd tempest-VolumeTypesAccessTest-1959282284 None] Volume volume-34549bf2-b4a3-45fe-af96-484a64801bc9 (34549bf2-b4a3-45fe-af96-484a64801bc9): created successfully
Sep 18 11:52:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8be8369c-0a7b-42ea-92f8-f7ff20617bfd tempest-VolumeTypesAccessTest-1959282284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09dc3ef6-7126-4672-b2b3-322a3e79afd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8be8369c-0a7b-42ea-92f8-f7ff20617bfd tempest-VolumeTypesAccessTest-1959282284 None] Flow 'volume_create_manager' (2d3a8e09-1f24-4ef1-b244-bce308e2668d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:52:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9238178b-a4d4-47bf-bc17-eb0f11cc4b25 tempest-VolumesActionsTest-740651357 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.422s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:15 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-8be8369c-0a7b-42ea-92f8-f7ff20617bfd tempest-VolumeTypesAccessTest-1959282284 None] Created volume successfully.
Sep 18 11:52:15 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-9238178b-a4d4-47bf-bc17-eb0f11cc4b25 tempest-VolumesActionsTest-740651357 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:52:15 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-9238178b-a4d4-47bf-bc17-eb0f11cc4b25 tempest-VolumesActionsTest-740651357 None] Deleted volume successfully.
Sep 18 11:52:15 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-1cbed2d5-0366-449c-8556-915c31698b82 tempest-VolumesActionsTest-1487175399 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:52:15 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cbed2d5-0366-449c-8556-915c31698b82 tempest-VolumesActionsTest-1487175399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:52:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1cbed2d5-0366-449c-8556-915c31698b82 tempest-VolumesActionsTest-1487175399 None] Flow 'volume_create_manager' (0362a3bd-966c-4e2b-97b7-ae64d723cf46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:52:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1cbed2d5-0366-449c-8556-915c31698b82 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62464467-c5d2-48ff-accb-8361892d10e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:15 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-9238178b-a4d4-47bf-bc17-eb0f11cc4b25 tempest-VolumesActionsTest-740651357 None] Lock "cinder-06181859-005d-4be8-8804-61f0f30a57b8-delete_volume" released by "delete_volume" :: held 3.249s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:52:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1cbed2d5-0366-449c-8556-915c31698b82 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62464467-c5d2-48ff-accb-8361892d10e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2088439166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6fcc5c7-79a5-4078-bf61-b6b806d9251d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='816bb0773bbd483d9b38b40ac8e0ea00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:52:15Z,use_quota=True,user_id='e3b9e62a6be74a13a4ddefaae9f375de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1cbed2d5-0366-449c-8556-915c31698b82 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f65c9535-b08a-451f-b360-ceac212016f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1cbed2d5-0366-449c-8556-915c31698b82 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f65c9535-b08a-451f-b360-ceac212016f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1cbed2d5-0366-449c-8556-915c31698b82 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f312ed4-1330-4ab6-9a76-eb01f8064b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1cbed2d5-0366-449c-8556-915c31698b82 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f312ed4-1330-4ab6-9a76-eb01f8064b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6fcc5c7-79a5-4078-bf61-b6b806d9251d', 'volume_name': 'volume-a6fcc5c7-79a5-4078-bf61-b6b806d9251d', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1cbed2d5-0366-449c-8556-915c31698b82 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b3761d6-7f25-4442-958a-cc05161ecafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1cbed2d5-0366-449c-8556-915c31698b82 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b3761d6-7f25-4442-958a-cc05161ecafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1cbed2d5-0366-449c-8556-915c31698b82 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87293ee0-0fd7-49d1-96c9-ab4c9cc5a070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:15 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-1cbed2d5-0366-449c-8556-915c31698b82 tempest-VolumesActionsTest-1487175399 None] Volume a6fcc5c7-79a5-4078-bf61-b6b806d9251d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6fcc5c7-79a5-4078-bf61-b6b806d9251d', 'volume_size': 1}
Sep 18 11:52:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1cbed2d5-0366-449c-8556-915c31698b82 tempest-VolumesActionsTest-1487175399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:52:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1cbed2d5-0366-449c-8556-915c31698b82 tempest-VolumesActionsTest-1487175399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:52:15 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-1cbed2d5-0366-449c-8556-915c31698b82 tempest-VolumesActionsTest-1487175399 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2088439166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6fcc5c7-79a5-4078-bf61-b6b806d9251d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='816bb0773bbd483d9b38b40ac8e0ea00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:52:15Z,use_quota=True,user_id='e3b9e62a6be74a13a4ddefaae9f375de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:52:15 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-1cbed2d5-0366-449c-8556-915c31698b82 tempest-VolumesActionsTest-1487175399 None] Creating volume a6fcc5c7-79a5-4078-bf61-b6b806d9251d {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:52:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1cbed2d5-0366-449c-8556-915c31698b82 tempest-VolumesActionsTest-1487175399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:52:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1cbed2d5-0366-449c-8556-915c31698b82 tempest-VolumesActionsTest-1487175399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:52:15 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-1cbed2d5-0366-449c-8556-915c31698b82 tempest-VolumesActionsTest-1487175399 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:52:15 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-1cbed2d5-0366-449c-8556-915c31698b82 tempest-VolumesActionsTest-1487175399 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:52:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1cbed2d5-0366-449c-8556-915c31698b82 tempest-VolumesActionsTest-1487175399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:52:15 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-1cbed2d5-0366-449c-8556-915c31698b82 tempest-VolumesActionsTest-1487175399 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:52:15 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-1cbed2d5-0366-449c-8556-915c31698b82 tempest-VolumesActionsTest-1487175399 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:52:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1cbed2d5-0366-449c-8556-915c31698b82 tempest-VolumesActionsTest-1487175399 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a6fcc5c7-79a5-4078-bf61-b6b806d9251d 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:15 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=91, name=volume-a6fcc5c7-79a5-4078-bf61-b6b806d9251d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:52:15 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-d0f7aedb-210e-4512-a0a1-0e672e6f110d tempest-VolumeTypesAccessTest-1959282284 None] Acquiring lock "cinder-34549bf2-b4a3-45fe-af96-484a64801bc9-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:52:15 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-d0f7aedb-210e-4512-a0a1-0e672e6f110d tempest-VolumeTypesAccessTest-1959282284 None] Lock "cinder-34549bf2-b4a3-45fe-af96-484a64801bc9-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:52:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1cbed2d5-0366-449c-8556-915c31698b82 tempest-VolumesActionsTest-1487175399 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a6fcc5c7-79a5-4078-bf61-b6b806d9251d 1073741824" returned: 0 in 0.441s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1cbed2d5-0366-449c-8556-915c31698b82 tempest-VolumesActionsTest-1487175399 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a6fcc5c7-79a5-4078-bf61-b6b806d9251d {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1cbed2d5-0366-449c-8556-915c31698b82 tempest-VolumesActionsTest-1487175399 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a6fcc5c7-79a5-4078-bf61-b6b806d9251d" returned: 0 in 0.313s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:16 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-d0f7aedb-210e-4512-a0a1-0e672e6f110d tempest-VolumeTypesAccessTest-1959282284 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:52:16 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-d0f7aedb-210e-4512-a0a1-0e672e6f110d tempest-VolumeTypesAccessTest-1959282284 None] Acquiring lock "cinder-quobyte-34549bf2-b4a3-45fe-af96-484a64801bc9" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:52:16 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-1cbed2d5-0366-449c-8556-915c31698b82 tempest-VolumesActionsTest-1487175399 None] <== create_volume: return (833ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:52:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1cbed2d5-0366-449c-8556-915c31698b82 tempest-VolumesActionsTest-1487175399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:52:16 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-d0f7aedb-210e-4512-a0a1-0e672e6f110d tempest-VolumeTypesAccessTest-1959282284 None] Lock "cinder-quobyte-34549bf2-b4a3-45fe-af96-484a64801bc9" acquired by "delete_volume" :: waited 0.061s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:52:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1cbed2d5-0366-449c-8556-915c31698b82 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87293ee0-0fd7-49d1-96c9-ab4c9cc5a070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6fcc5c7-79a5-4078-bf61-b6b806d9251d', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1cbed2d5-0366-449c-8556-915c31698b82 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a8f145f-4ff4-4a8f-9786-a292b3d60058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:16 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0164e654-a7f7-402f-8057-8747c6165933]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:52:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d0f7aedb-210e-4512-a0a1-0e672e6f110d tempest-VolumeTypesAccessTest-1959282284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-34549bf2-b4a3-45fe-af96-484a64801bc9 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:16 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-1cbed2d5-0366-449c-8556-915c31698b82 tempest-VolumesActionsTest-1487175399 None] Volume volume-a6fcc5c7-79a5-4078-bf61-b6b806d9251d (a6fcc5c7-79a5-4078-bf61-b6b806d9251d): created successfully
Sep 18 11:52:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1cbed2d5-0366-449c-8556-915c31698b82 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a8f145f-4ff4-4a8f-9786-a292b3d60058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1cbed2d5-0366-449c-8556-915c31698b82 tempest-VolumesActionsTest-1487175399 None] Flow 'volume_create_manager' (0362a3bd-966c-4e2b-97b7-ae64d723cf46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:52:16 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-1cbed2d5-0366-449c-8556-915c31698b82 tempest-VolumesActionsTest-1487175399 None] Created volume successfully.
Sep 18 11:52:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d0f7aedb-210e-4512-a0a1-0e672e6f110d tempest-VolumeTypesAccessTest-1959282284 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-34549bf2-b4a3-45fe-af96-484a64801bc9" returned: 0 in 0.530s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d0f7aedb-210e-4512-a0a1-0e672e6f110d tempest-VolumeTypesAccessTest-1959282284 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-34549bf2-b4a3-45fe-af96-484a64801bc9 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d0f7aedb-210e-4512-a0a1-0e672e6f110d tempest-VolumeTypesAccessTest-1959282284 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-34549bf2-b4a3-45fe-af96-484a64801bc9" returned: 0 in 0.091s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:17 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-d0f7aedb-210e-4512-a0a1-0e672e6f110d tempest-VolumeTypesAccessTest-1959282284 None] Lock "cinder-quobyte-34549bf2-b4a3-45fe-af96-484a64801bc9" released by "delete_volume" :: held 0.785s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:52:17 devstack cinder-volume[83176]: WARNING cinder.quota [None req-d0f7aedb-210e-4512-a0a1-0e672e6f110d tempest-VolumeTypesAccessTest-1959282284 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-803675618 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-803675618, it is now deprecated. Please use the default quota class for default quota.
Sep 18 11:52:17 devstack cinder-volume[83176]: WARNING cinder.quota [None req-d0f7aedb-210e-4512-a0a1-0e672e6f110d tempest-VolumeTypesAccessTest-1959282284 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-803675618 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-803675618, it is now deprecated. Please use the default quota class for default quota.
Sep 18 11:52:17 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-d0f7aedb-210e-4512-a0a1-0e672e6f110d tempest-VolumeTypesAccessTest-1959282284 None] Created reservations ['488e8103-43fc-43a3-a7a5-848cc8bacb3d', '8c60bedb-e88f-463a-a293-57abc622107a', '642fa7bb-974c-4bf3-b220-fbb41a69fc83', '0a2eff07-606c-41b4-998c-cc8642c198ad'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:52:17 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-2abbd623-1c53-4888-ad88-10862d019535 tempest-VolumesActionsTest-740651357 None] Acquiring lock "cinder-a6fcc5c7-79a5-4078-bf61-b6b806d9251d-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:52:17 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-2abbd623-1c53-4888-ad88-10862d019535 tempest-VolumesActionsTest-740651357 None] Lock "cinder-a6fcc5c7-79a5-4078-bf61-b6b806d9251d-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:52:17 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-2abbd623-1c53-4888-ad88-10862d019535 tempest-VolumesActionsTest-740651357 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:52:17 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-2abbd623-1c53-4888-ad88-10862d019535 tempest-VolumesActionsTest-740651357 None] Acquiring lock "cinder-quobyte-a6fcc5c7-79a5-4078-bf61-b6b806d9251d" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:52:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d0f7aedb-210e-4512-a0a1-0e672e6f110d tempest-VolumeTypesAccessTest-1959282284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:52:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d0f7aedb-210e-4512-a0a1-0e672e6f110d tempest-VolumeTypesAccessTest-1959282284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:52:17 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-d0f7aedb-210e-4512-a0a1-0e672e6f110d tempest-VolumeTypesAccessTest-1959282284 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:52:17 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-d0f7aedb-210e-4512-a0a1-0e672e6f110d tempest-VolumeTypesAccessTest-1959282284 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:52:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d0f7aedb-210e-4512-a0a1-0e672e6f110d tempest-VolumeTypesAccessTest-1959282284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:52:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d0f7aedb-210e-4512-a0a1-0e672e6f110d tempest-VolumeTypesAccessTest-1959282284 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d0f7aedb-210e-4512-a0a1-0e672e6f110d tempest-VolumeTypesAccessTest-1959282284 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.183s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:17 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-d0f7aedb-210e-4512-a0a1-0e672e6f110d tempest-VolumeTypesAccessTest-1959282284 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:52:18 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-d0f7aedb-210e-4512-a0a1-0e672e6f110d tempest-VolumeTypesAccessTest-1959282284 None] Deleted volume successfully.
Sep 18 11:52:18 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-2abbd623-1c53-4888-ad88-10862d019535 tempest-VolumesActionsTest-740651357 None] Lock "cinder-quobyte-a6fcc5c7-79a5-4078-bf61-b6b806d9251d" acquired by "delete_volume" :: waited 0.443s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:52:18 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcdf6a3-6fc0-47cc-ae3d-855cd446426f]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:52:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2abbd623-1c53-4888-ad88-10862d019535 tempest-VolumesActionsTest-740651357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a6fcc5c7-79a5-4078-bf61-b6b806d9251d {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:18 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-d0f7aedb-210e-4512-a0a1-0e672e6f110d tempest-VolumeTypesAccessTest-1959282284 None] Lock "cinder-34549bf2-b4a3-45fe-af96-484a64801bc9-delete_volume" released by "delete_volume" :: held 2.533s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:52:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2abbd623-1c53-4888-ad88-10862d019535 tempest-VolumesActionsTest-740651357 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a6fcc5c7-79a5-4078-bf61-b6b806d9251d" returned: 0 in 0.542s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2abbd623-1c53-4888-ad88-10862d019535 tempest-VolumesActionsTest-740651357 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a6fcc5c7-79a5-4078-bf61-b6b806d9251d {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2abbd623-1c53-4888-ad88-10862d019535 tempest-VolumesActionsTest-740651357 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a6fcc5c7-79a5-4078-bf61-b6b806d9251d" returned: 0 in 0.144s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:19 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-2abbd623-1c53-4888-ad88-10862d019535 tempest-VolumesActionsTest-740651357 None] Lock "cinder-quobyte-a6fcc5c7-79a5-4078-bf61-b6b806d9251d" released by "delete_volume" :: held 0.935s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:52:19 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-2abbd623-1c53-4888-ad88-10862d019535 tempest-VolumesActionsTest-740651357 None] Created reservations ['6408c275-a8b5-4b41-a61d-38a014e3d7cb', '9e7248a4-db54-446e-8f3e-1e76ee0508be', 'b7d55f44-d8ed-416d-a286-82d9d8c1873d', '93e9d916-e4b2-461a-9df6-9fb05d000c08'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:52:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-2abbd623-1c53-4888-ad88-10862d019535 tempest-VolumesActionsTest-740651357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:52:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-2abbd623-1c53-4888-ad88-10862d019535 tempest-VolumesActionsTest-740651357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:52:19 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-2abbd623-1c53-4888-ad88-10862d019535 tempest-VolumesActionsTest-740651357 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:52:19 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-2abbd623-1c53-4888-ad88-10862d019535 tempest-VolumesActionsTest-740651357 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:52:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-2abbd623-1c53-4888-ad88-10862d019535 tempest-VolumesActionsTest-740651357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:52:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2abbd623-1c53-4888-ad88-10862d019535 tempest-VolumesActionsTest-740651357 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2abbd623-1c53-4888-ad88-10862d019535 tempest-VolumesActionsTest-740651357 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.105s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:19 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-2abbd623-1c53-4888-ad88-10862d019535 tempest-VolumesActionsTest-740651357 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:52:19 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-2abbd623-1c53-4888-ad88-10862d019535 tempest-VolumesActionsTest-740651357 None] Deleted volume successfully.
Sep 18 11:52:20 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-2abbd623-1c53-4888-ad88-10862d019535 tempest-VolumesActionsTest-740651357 None] Lock "cinder-a6fcc5c7-79a5-4078-bf61-b6b806d9251d-delete_volume" released by "delete_volume" :: held 2.466s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:52:20 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-0ee3cf84-6866-4cc8-8f93-d19aecbb4b0f tempest-VolumesActionsTest-1487175399 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:52:20 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ee3cf84-6866-4cc8-8f93-d19aecbb4b0f tempest-VolumesActionsTest-1487175399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:52:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0ee3cf84-6866-4cc8-8f93-d19aecbb4b0f tempest-VolumesActionsTest-1487175399 None] Flow 'volume_create_manager' (ab596d04-5302-42c0-8a39-9dae7893dd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:52:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0ee3cf84-6866-4cc8-8f93-d19aecbb4b0f tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91a9967c-9f36-46cc-8722-0cb9cede102a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0ee3cf84-6866-4cc8-8f93-d19aecbb4b0f tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91a9967c-9f36-46cc-8722-0cb9cede102a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1240578475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82216d6a-8b2e-4359-a55d-bdaae0ea4411,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='816bb0773bbd483d9b38b40ac8e0ea00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:52:21Z,use_quota=True,user_id='e3b9e62a6be74a13a4ddefaae9f375de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0ee3cf84-6866-4cc8-8f93-d19aecbb4b0f tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bc1aece-2462-483e-9998-1546aaec874a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0ee3cf84-6866-4cc8-8f93-d19aecbb4b0f tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bc1aece-2462-483e-9998-1546aaec874a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0ee3cf84-6866-4cc8-8f93-d19aecbb4b0f tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be3e6fc6-fdfd-4883-abda-b486c7042170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0ee3cf84-6866-4cc8-8f93-d19aecbb4b0f tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be3e6fc6-fdfd-4883-abda-b486c7042170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82216d6a-8b2e-4359-a55d-bdaae0ea4411', 'volume_name': 'volume-82216d6a-8b2e-4359-a55d-bdaae0ea4411', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0ee3cf84-6866-4cc8-8f93-d19aecbb4b0f tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a022c166-7c17-4f28-8b70-bead34bb8c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0ee3cf84-6866-4cc8-8f93-d19aecbb4b0f tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a022c166-7c17-4f28-8b70-bead34bb8c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0ee3cf84-6866-4cc8-8f93-d19aecbb4b0f tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf7ae61-e579-4e8b-b03b-7d014e04f1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:20 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-0ee3cf84-6866-4cc8-8f93-d19aecbb4b0f tempest-VolumesActionsTest-1487175399 None] Volume 82216d6a-8b2e-4359-a55d-bdaae0ea4411: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82216d6a-8b2e-4359-a55d-bdaae0ea4411', 'volume_size': 1}
Sep 18 11:52:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0ee3cf84-6866-4cc8-8f93-d19aecbb4b0f tempest-VolumesActionsTest-1487175399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:52:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0ee3cf84-6866-4cc8-8f93-d19aecbb4b0f tempest-VolumesActionsTest-1487175399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:52:20 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-0ee3cf84-6866-4cc8-8f93-d19aecbb4b0f tempest-VolumesActionsTest-1487175399 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1240578475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82216d6a-8b2e-4359-a55d-bdaae0ea4411,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='816bb0773bbd483d9b38b40ac8e0ea00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:52:21Z,use_quota=True,user_id='e3b9e62a6be74a13a4ddefaae9f375de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:52:20 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-0ee3cf84-6866-4cc8-8f93-d19aecbb4b0f tempest-VolumesActionsTest-1487175399 None] Creating volume 82216d6a-8b2e-4359-a55d-bdaae0ea4411 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:52:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0ee3cf84-6866-4cc8-8f93-d19aecbb4b0f tempest-VolumesActionsTest-1487175399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:52:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0ee3cf84-6866-4cc8-8f93-d19aecbb4b0f tempest-VolumesActionsTest-1487175399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:52:20 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-0ee3cf84-6866-4cc8-8f93-d19aecbb4b0f tempest-VolumesActionsTest-1487175399 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:52:20 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-0ee3cf84-6866-4cc8-8f93-d19aecbb4b0f tempest-VolumesActionsTest-1487175399 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:52:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0ee3cf84-6866-4cc8-8f93-d19aecbb4b0f tempest-VolumesActionsTest-1487175399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:52:20 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-0ee3cf84-6866-4cc8-8f93-d19aecbb4b0f tempest-VolumesActionsTest-1487175399 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:52:20 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-0ee3cf84-6866-4cc8-8f93-d19aecbb4b0f tempest-VolumesActionsTest-1487175399 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:52:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0ee3cf84-6866-4cc8-8f93-d19aecbb4b0f tempest-VolumesActionsTest-1487175399 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-82216d6a-8b2e-4359-a55d-bdaae0ea4411 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:21 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=92, name=volume-82216d6a-8b2e-4359-a55d-bdaae0ea4411, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:52:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0ee3cf84-6866-4cc8-8f93-d19aecbb4b0f tempest-VolumesActionsTest-1487175399 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-82216d6a-8b2e-4359-a55d-bdaae0ea4411 1073741824" returned: 0 in 0.436s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0ee3cf84-6866-4cc8-8f93-d19aecbb4b0f tempest-VolumesActionsTest-1487175399 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-82216d6a-8b2e-4359-a55d-bdaae0ea4411 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0ee3cf84-6866-4cc8-8f93-d19aecbb4b0f tempest-VolumesActionsTest-1487175399 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-82216d6a-8b2e-4359-a55d-bdaae0ea4411" returned: 0 in 0.143s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:21 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-0ee3cf84-6866-4cc8-8f93-d19aecbb4b0f tempest-VolumesActionsTest-1487175399 None] <== create_volume: return (651ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:52:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0ee3cf84-6866-4cc8-8f93-d19aecbb4b0f tempest-VolumesActionsTest-1487175399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.667s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:52:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0ee3cf84-6866-4cc8-8f93-d19aecbb4b0f tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf7ae61-e579-4e8b-b03b-7d014e04f1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82216d6a-8b2e-4359-a55d-bdaae0ea4411', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0ee3cf84-6866-4cc8-8f93-d19aecbb4b0f tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa14186a-ac42-46cc-ae56-f1ece836a25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:21 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-0ee3cf84-6866-4cc8-8f93-d19aecbb4b0f tempest-VolumesActionsTest-1487175399 None] Volume volume-82216d6a-8b2e-4359-a55d-bdaae0ea4411 (82216d6a-8b2e-4359-a55d-bdaae0ea4411): created successfully
Sep 18 11:52:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0ee3cf84-6866-4cc8-8f93-d19aecbb4b0f tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa14186a-ac42-46cc-ae56-f1ece836a25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0ee3cf84-6866-4cc8-8f93-d19aecbb4b0f tempest-VolumesActionsTest-1487175399 None] Flow 'volume_create_manager' (ab596d04-5302-42c0-8a39-9dae7893dd86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:52:21 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-0ee3cf84-6866-4cc8-8f93-d19aecbb4b0f tempest-VolumesActionsTest-1487175399 None] Created volume successfully.
Sep 18 11:52:23 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-7e761cb2-44f4-44a7-a8b9-254366b336c8 tempest-VolumesActionsTest-740651357 None] Acquiring lock "cinder-82216d6a-8b2e-4359-a55d-bdaae0ea4411-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:52:23 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-7e761cb2-44f4-44a7-a8b9-254366b336c8 tempest-VolumesActionsTest-740651357 None] Lock "cinder-82216d6a-8b2e-4359-a55d-bdaae0ea4411-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:52:23 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-7e761cb2-44f4-44a7-a8b9-254366b336c8 tempest-VolumesActionsTest-740651357 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:52:23 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-7e761cb2-44f4-44a7-a8b9-254366b336c8 tempest-VolumesActionsTest-740651357 None] Acquiring lock "cinder-quobyte-82216d6a-8b2e-4359-a55d-bdaae0ea4411" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:52:23 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-7e761cb2-44f4-44a7-a8b9-254366b336c8 tempest-VolumesActionsTest-740651357 None] Lock "cinder-quobyte-82216d6a-8b2e-4359-a55d-bdaae0ea4411" acquired by "delete_volume" :: waited 0.020s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:52:23 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c3774c-3591-4189-bdc6-51570991b4bc]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:52:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7e761cb2-44f4-44a7-a8b9-254366b336c8 tempest-VolumesActionsTest-740651357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-82216d6a-8b2e-4359-a55d-bdaae0ea4411 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7e761cb2-44f4-44a7-a8b9-254366b336c8 tempest-VolumesActionsTest-740651357 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-82216d6a-8b2e-4359-a55d-bdaae0ea4411" returned: 0 in 0.483s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7e761cb2-44f4-44a7-a8b9-254366b336c8 tempest-VolumesActionsTest-740651357 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-82216d6a-8b2e-4359-a55d-bdaae0ea4411 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7e761cb2-44f4-44a7-a8b9-254366b336c8 tempest-VolumesActionsTest-740651357 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-82216d6a-8b2e-4359-a55d-bdaae0ea4411" returned: 0 in 0.104s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:24 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-7e761cb2-44f4-44a7-a8b9-254366b336c8 tempest-VolumesActionsTest-740651357 None] Lock "cinder-quobyte-82216d6a-8b2e-4359-a55d-bdaae0ea4411" released by "delete_volume" :: held 0.742s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:52:24 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-7e761cb2-44f4-44a7-a8b9-254366b336c8 tempest-VolumesActionsTest-740651357 None] Created reservations ['72e7974c-2d37-4372-9049-eb83483905ed', 'f568c764-a406-4aab-90a6-23ebd006689d', 'd5db49bd-f196-48b9-bcba-d1fccfd30971', '7ac49ad7-a5be-4839-8ffb-c5e1552b20e1'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:52:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-7e761cb2-44f4-44a7-a8b9-254366b336c8 tempest-VolumesActionsTest-740651357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:52:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-7e761cb2-44f4-44a7-a8b9-254366b336c8 tempest-VolumesActionsTest-740651357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:52:24 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-7e761cb2-44f4-44a7-a8b9-254366b336c8 tempest-VolumesActionsTest-740651357 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:52:24 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-7e761cb2-44f4-44a7-a8b9-254366b336c8 tempest-VolumesActionsTest-740651357 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:52:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-7e761cb2-44f4-44a7-a8b9-254366b336c8 tempest-VolumesActionsTest-740651357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:52:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7e761cb2-44f4-44a7-a8b9-254366b336c8 tempest-VolumesActionsTest-740651357 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7e761cb2-44f4-44a7-a8b9-254366b336c8 tempest-VolumesActionsTest-740651357 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.103s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:24 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-7e761cb2-44f4-44a7-a8b9-254366b336c8 tempest-VolumesActionsTest-740651357 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:52:24 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-7e761cb2-44f4-44a7-a8b9-254366b336c8 tempest-VolumesActionsTest-740651357 None] Deleted volume successfully.
Sep 18 11:52:25 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-7e761cb2-44f4-44a7-a8b9-254366b336c8 tempest-VolumesActionsTest-740651357 None] Lock "cinder-82216d6a-8b2e-4359-a55d-bdaae0ea4411-delete_volume" released by "delete_volume" :: held 1.891s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:52:25 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-0554e4ca-2109-405b-9808-ac55dd3e508f tempest-VolumesActionsTest-1487175399 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:52:25 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-0554e4ca-2109-405b-9808-ac55dd3e508f tempest-VolumesActionsTest-1487175399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:52:26 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0554e4ca-2109-405b-9808-ac55dd3e508f tempest-VolumesActionsTest-1487175399 None] Flow 'volume_create_manager' (67533d6a-2469-40e2-a5e2-36bf8fb279d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:52:26 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0554e4ca-2109-405b-9808-ac55dd3e508f tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (622cfafd-610e-4977-b2e6-f207170d52c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:26 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0554e4ca-2109-405b-9808-ac55dd3e508f tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (622cfafd-610e-4977-b2e6-f207170d52c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1235553857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c57fc7a6-1412-4cc3-9f2a-2af403c1e69c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='816bb0773bbd483d9b38b40ac8e0ea00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:52:26Z,use_quota=True,user_id='e3b9e62a6be74a13a4ddefaae9f375de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:26 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0554e4ca-2109-405b-9808-ac55dd3e508f tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf5aba6-1989-4b89-8628-5b71d68fc20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:26 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0554e4ca-2109-405b-9808-ac55dd3e508f tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf5aba6-1989-4b89-8628-5b71d68fc20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:26 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0554e4ca-2109-405b-9808-ac55dd3e508f tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c75dcc-f387-44c7-8489-2b00f667af28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:26 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0554e4ca-2109-405b-9808-ac55dd3e508f tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c75dcc-f387-44c7-8489-2b00f667af28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c57fc7a6-1412-4cc3-9f2a-2af403c1e69c', 'volume_name': 'volume-c57fc7a6-1412-4cc3-9f2a-2af403c1e69c', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:26 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0554e4ca-2109-405b-9808-ac55dd3e508f tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2707923-e843-4a44-a6d0-17778a6c0931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:26 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0554e4ca-2109-405b-9808-ac55dd3e508f tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2707923-e843-4a44-a6d0-17778a6c0931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:26 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0554e4ca-2109-405b-9808-ac55dd3e508f tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5e11360-a899-4fda-aabf-be5db1ba7868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:26 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-0554e4ca-2109-405b-9808-ac55dd3e508f tempest-VolumesActionsTest-1487175399 None] Volume c57fc7a6-1412-4cc3-9f2a-2af403c1e69c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c57fc7a6-1412-4cc3-9f2a-2af403c1e69c', 'volume_size': 1}
Sep 18 11:52:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0554e4ca-2109-405b-9808-ac55dd3e508f tempest-VolumesActionsTest-1487175399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:52:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0554e4ca-2109-405b-9808-ac55dd3e508f tempest-VolumesActionsTest-1487175399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:52:26 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-0554e4ca-2109-405b-9808-ac55dd3e508f tempest-VolumesActionsTest-1487175399 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1235553857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c57fc7a6-1412-4cc3-9f2a-2af403c1e69c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='816bb0773bbd483d9b38b40ac8e0ea00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:52:26Z,use_quota=True,user_id='e3b9e62a6be74a13a4ddefaae9f375de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:52:26 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-0554e4ca-2109-405b-9808-ac55dd3e508f tempest-VolumesActionsTest-1487175399 None] Creating volume c57fc7a6-1412-4cc3-9f2a-2af403c1e69c {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:52:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0554e4ca-2109-405b-9808-ac55dd3e508f tempest-VolumesActionsTest-1487175399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:52:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0554e4ca-2109-405b-9808-ac55dd3e508f tempest-VolumesActionsTest-1487175399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:52:26 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-0554e4ca-2109-405b-9808-ac55dd3e508f tempest-VolumesActionsTest-1487175399 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:52:26 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-0554e4ca-2109-405b-9808-ac55dd3e508f tempest-VolumesActionsTest-1487175399 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:52:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0554e4ca-2109-405b-9808-ac55dd3e508f tempest-VolumesActionsTest-1487175399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:52:26 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-0554e4ca-2109-405b-9808-ac55dd3e508f tempest-VolumesActionsTest-1487175399 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:52:26 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-0554e4ca-2109-405b-9808-ac55dd3e508f tempest-VolumesActionsTest-1487175399 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:52:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0554e4ca-2109-405b-9808-ac55dd3e508f tempest-VolumesActionsTest-1487175399 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c57fc7a6-1412-4cc3-9f2a-2af403c1e69c 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:26 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=93, name=volume-c57fc7a6-1412-4cc3-9f2a-2af403c1e69c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:52:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0554e4ca-2109-405b-9808-ac55dd3e508f tempest-VolumesActionsTest-1487175399 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c57fc7a6-1412-4cc3-9f2a-2af403c1e69c 1073741824" returned: 0 in 0.379s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0554e4ca-2109-405b-9808-ac55dd3e508f tempest-VolumesActionsTest-1487175399 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c57fc7a6-1412-4cc3-9f2a-2af403c1e69c {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0554e4ca-2109-405b-9808-ac55dd3e508f tempest-VolumesActionsTest-1487175399 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c57fc7a6-1412-4cc3-9f2a-2af403c1e69c" returned: 0 in 0.093s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:26 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-0554e4ca-2109-405b-9808-ac55dd3e508f tempest-VolumesActionsTest-1487175399 None] <== create_volume: return (547ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:52:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0554e4ca-2109-405b-9808-ac55dd3e508f tempest-VolumesActionsTest-1487175399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.559s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:52:26 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0554e4ca-2109-405b-9808-ac55dd3e508f tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5e11360-a899-4fda-aabf-be5db1ba7868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c57fc7a6-1412-4cc3-9f2a-2af403c1e69c', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:26 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0554e4ca-2109-405b-9808-ac55dd3e508f tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09f7e9c8-4798-4b02-935a-463d6e1410c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:27 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-0554e4ca-2109-405b-9808-ac55dd3e508f tempest-VolumesActionsTest-1487175399 None] Volume volume-c57fc7a6-1412-4cc3-9f2a-2af403c1e69c (c57fc7a6-1412-4cc3-9f2a-2af403c1e69c): created successfully
Sep 18 11:52:27 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0554e4ca-2109-405b-9808-ac55dd3e508f tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09f7e9c8-4798-4b02-935a-463d6e1410c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:27 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0554e4ca-2109-405b-9808-ac55dd3e508f tempest-VolumesActionsTest-1487175399 None] Flow 'volume_create_manager' (67533d6a-2469-40e2-a5e2-36bf8fb279d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:52:27 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-0554e4ca-2109-405b-9808-ac55dd3e508f tempest-VolumesActionsTest-1487175399 None] Created volume successfully.
Sep 18 11:52:28 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-8ff02584-05da-4611-a872-ce46dee9df3a tempest-VolumesActionsTest-740651357 None] Acquiring lock "cinder-c57fc7a6-1412-4cc3-9f2a-2af403c1e69c-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:52:28 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-8ff02584-05da-4611-a872-ce46dee9df3a tempest-VolumesActionsTest-740651357 None] Lock "cinder-c57fc7a6-1412-4cc3-9f2a-2af403c1e69c-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:52:28 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-8ff02584-05da-4611-a872-ce46dee9df3a tempest-VolumesActionsTest-740651357 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:52:28 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-8ff02584-05da-4611-a872-ce46dee9df3a tempest-VolumesActionsTest-740651357 None] Acquiring lock "cinder-quobyte-c57fc7a6-1412-4cc3-9f2a-2af403c1e69c" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:52:28 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-8ff02584-05da-4611-a872-ce46dee9df3a tempest-VolumesActionsTest-740651357 None] Lock "cinder-quobyte-c57fc7a6-1412-4cc3-9f2a-2af403c1e69c" acquired by "delete_volume" :: waited 0.013s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:52:28 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc372c3-d1ef-4657-876f-bbc5679b8705]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:52:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8ff02584-05da-4611-a872-ce46dee9df3a tempest-VolumesActionsTest-740651357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c57fc7a6-1412-4cc3-9f2a-2af403c1e69c {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8ff02584-05da-4611-a872-ce46dee9df3a tempest-VolumesActionsTest-740651357 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c57fc7a6-1412-4cc3-9f2a-2af403c1e69c" returned: 0 in 0.449s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8ff02584-05da-4611-a872-ce46dee9df3a tempest-VolumesActionsTest-740651357 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c57fc7a6-1412-4cc3-9f2a-2af403c1e69c {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8ff02584-05da-4611-a872-ce46dee9df3a tempest-VolumesActionsTest-740651357 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c57fc7a6-1412-4cc3-9f2a-2af403c1e69c" returned: 0 in 0.117s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:29 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-8ff02584-05da-4611-a872-ce46dee9df3a tempest-VolumesActionsTest-740651357 None] Lock "cinder-quobyte-c57fc7a6-1412-4cc3-9f2a-2af403c1e69c" released by "delete_volume" :: held 0.727s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:52:29 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-8ff02584-05da-4611-a872-ce46dee9df3a tempest-VolumesActionsTest-740651357 None] Created reservations ['cf83332a-2c7d-48fe-a436-1331a01b37a4', 'ab66397d-82c2-42aa-8dc1-68d24d0dc947', '3219d09b-5cac-47a6-9443-9091601ff45a', '43b1352c-9043-4331-a246-7b6cae3333e2'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:52:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-8ff02584-05da-4611-a872-ce46dee9df3a tempest-VolumesActionsTest-740651357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:52:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-8ff02584-05da-4611-a872-ce46dee9df3a tempest-VolumesActionsTest-740651357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:52:29 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-8ff02584-05da-4611-a872-ce46dee9df3a tempest-VolumesActionsTest-740651357 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:52:29 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-8ff02584-05da-4611-a872-ce46dee9df3a tempest-VolumesActionsTest-740651357 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:52:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-8ff02584-05da-4611-a872-ce46dee9df3a tempest-VolumesActionsTest-740651357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:52:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8ff02584-05da-4611-a872-ce46dee9df3a tempest-VolumesActionsTest-740651357 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8ff02584-05da-4611-a872-ce46dee9df3a tempest-VolumesActionsTest-740651357 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.101s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:29 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-8ff02584-05da-4611-a872-ce46dee9df3a tempest-VolumesActionsTest-740651357 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:52:30 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-8ff02584-05da-4611-a872-ce46dee9df3a tempest-VolumesActionsTest-740651357 None] Deleted volume successfully.
Sep 18 11:52:30 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-8ff02584-05da-4611-a872-ce46dee9df3a tempest-VolumesActionsTest-740651357 None] Lock "cinder-c57fc7a6-1412-4cc3-9f2a-2af403c1e69c-delete_volume" released by "delete_volume" :: held 1.906s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:52:31 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-c428da21-cffe-471c-a15e-8c4419c95d90 tempest-VolumesActionsTest-1487175399 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:52:31 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-c428da21-cffe-471c-a15e-8c4419c95d90 tempest-VolumesActionsTest-1487175399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:52:31 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c428da21-cffe-471c-a15e-8c4419c95d90 tempest-VolumesActionsTest-1487175399 None] Flow 'volume_create_manager' (84473747-7c49-4534-84b7-5cd97efaa97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:52:31 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c428da21-cffe-471c-a15e-8c4419c95d90 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24c9e540-6d06-4f1c-a49f-5268810261ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:31 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c428da21-cffe-471c-a15e-8c4419c95d90 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24c9e540-6d06-4f1c-a49f-5268810261ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1454070839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ab3b754-74e1-4e45-840a-afb7e6e586fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='816bb0773bbd483d9b38b40ac8e0ea00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:52:31Z,use_quota=True,user_id='e3b9e62a6be74a13a4ddefaae9f375de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:31 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c428da21-cffe-471c-a15e-8c4419c95d90 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3dcdb5f-9152-4531-ab46-cf847b47de94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:31 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c428da21-cffe-471c-a15e-8c4419c95d90 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3dcdb5f-9152-4531-ab46-cf847b47de94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:31 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c428da21-cffe-471c-a15e-8c4419c95d90 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a991d3e-e9f4-46b1-8f27-b564a5e84284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:31 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c428da21-cffe-471c-a15e-8c4419c95d90 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a991d3e-e9f4-46b1-8f27-b564a5e84284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ab3b754-74e1-4e45-840a-afb7e6e586fa', 'volume_name': 'volume-5ab3b754-74e1-4e45-840a-afb7e6e586fa', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:31 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c428da21-cffe-471c-a15e-8c4419c95d90 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f0287c7-3865-4b81-a63c-0362b0350c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:31 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c428da21-cffe-471c-a15e-8c4419c95d90 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f0287c7-3865-4b81-a63c-0362b0350c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:31 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c428da21-cffe-471c-a15e-8c4419c95d90 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8920a10e-e15d-4950-b644-8d346fed2bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:31 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-c428da21-cffe-471c-a15e-8c4419c95d90 tempest-VolumesActionsTest-1487175399 None] Volume 5ab3b754-74e1-4e45-840a-afb7e6e586fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ab3b754-74e1-4e45-840a-afb7e6e586fa', 'volume_size': 1}
Sep 18 11:52:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-c428da21-cffe-471c-a15e-8c4419c95d90 tempest-VolumesActionsTest-1487175399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:52:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-c428da21-cffe-471c-a15e-8c4419c95d90 tempest-VolumesActionsTest-1487175399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:52:31 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-c428da21-cffe-471c-a15e-8c4419c95d90 tempest-VolumesActionsTest-1487175399 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1454070839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ab3b754-74e1-4e45-840a-afb7e6e586fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='816bb0773bbd483d9b38b40ac8e0ea00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:52:31Z,use_quota=True,user_id='e3b9e62a6be74a13a4ddefaae9f375de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:52:31 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-c428da21-cffe-471c-a15e-8c4419c95d90 tempest-VolumesActionsTest-1487175399 None] Creating volume 5ab3b754-74e1-4e45-840a-afb7e6e586fa {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:52:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-c428da21-cffe-471c-a15e-8c4419c95d90 tempest-VolumesActionsTest-1487175399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:52:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-c428da21-cffe-471c-a15e-8c4419c95d90 tempest-VolumesActionsTest-1487175399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:52:31 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-c428da21-cffe-471c-a15e-8c4419c95d90 tempest-VolumesActionsTest-1487175399 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:52:31 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-c428da21-cffe-471c-a15e-8c4419c95d90 tempest-VolumesActionsTest-1487175399 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:52:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-c428da21-cffe-471c-a15e-8c4419c95d90 tempest-VolumesActionsTest-1487175399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:52:31 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-c428da21-cffe-471c-a15e-8c4419c95d90 tempest-VolumesActionsTest-1487175399 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:52:31 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-c428da21-cffe-471c-a15e-8c4419c95d90 tempest-VolumesActionsTest-1487175399 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:52:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c428da21-cffe-471c-a15e-8c4419c95d90 tempest-VolumesActionsTest-1487175399 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5ab3b754-74e1-4e45-840a-afb7e6e586fa 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:31 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=94, name=volume-5ab3b754-74e1-4e45-840a-afb7e6e586fa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:52:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c428da21-cffe-471c-a15e-8c4419c95d90 tempest-VolumesActionsTest-1487175399 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5ab3b754-74e1-4e45-840a-afb7e6e586fa 1073741824" returned: 0 in 0.364s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c428da21-cffe-471c-a15e-8c4419c95d90 tempest-VolumesActionsTest-1487175399 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5ab3b754-74e1-4e45-840a-afb7e6e586fa {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c428da21-cffe-471c-a15e-8c4419c95d90 tempest-VolumesActionsTest-1487175399 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5ab3b754-74e1-4e45-840a-afb7e6e586fa" returned: 0 in 0.162s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:32 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-c428da21-cffe-471c-a15e-8c4419c95d90 tempest-VolumesActionsTest-1487175399 None] <== create_volume: return (597ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:52:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-c428da21-cffe-471c-a15e-8c4419c95d90 tempest-VolumesActionsTest-1487175399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.610s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:52:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c428da21-cffe-471c-a15e-8c4419c95d90 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8920a10e-e15d-4950-b644-8d346fed2bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ab3b754-74e1-4e45-840a-afb7e6e586fa', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c428da21-cffe-471c-a15e-8c4419c95d90 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df3cfdda-1945-46e6-9931-59b52897c2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:32 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-c428da21-cffe-471c-a15e-8c4419c95d90 tempest-VolumesActionsTest-1487175399 None] Volume volume-5ab3b754-74e1-4e45-840a-afb7e6e586fa (5ab3b754-74e1-4e45-840a-afb7e6e586fa): created successfully
Sep 18 11:52:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c428da21-cffe-471c-a15e-8c4419c95d90 tempest-VolumesActionsTest-1487175399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df3cfdda-1945-46e6-9931-59b52897c2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c428da21-cffe-471c-a15e-8c4419c95d90 tempest-VolumesActionsTest-1487175399 None] Flow 'volume_create_manager' (84473747-7c49-4534-84b7-5cd97efaa97a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:52:32 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-c428da21-cffe-471c-a15e-8c4419c95d90 tempest-VolumesActionsTest-1487175399 None] Created volume successfully.
Sep 18 11:52:34 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-949648cd-b30f-4d8b-9860-8f9de0b4cc8e tempest-VolumesActionsTest-1487175399 None] Acquiring lock "cinder-5ab3b754-74e1-4e45-840a-afb7e6e586fa-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:52:34 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-949648cd-b30f-4d8b-9860-8f9de0b4cc8e tempest-VolumesActionsTest-1487175399 None] Lock "cinder-5ab3b754-74e1-4e45-840a-afb7e6e586fa-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:52:34 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-949648cd-b30f-4d8b-9860-8f9de0b4cc8e tempest-VolumesActionsTest-1487175399 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:52:34 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-949648cd-b30f-4d8b-9860-8f9de0b4cc8e tempest-VolumesActionsTest-1487175399 None] Acquiring lock "cinder-quobyte-5ab3b754-74e1-4e45-840a-afb7e6e586fa" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:52:34 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-949648cd-b30f-4d8b-9860-8f9de0b4cc8e tempest-VolumesActionsTest-1487175399 None] Lock "cinder-quobyte-5ab3b754-74e1-4e45-840a-afb7e6e586fa" acquired by "delete_volume" :: waited 0.012s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:52:34 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9680a417-cfed-4f55-96e8-62772743ffee]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:52:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-949648cd-b30f-4d8b-9860-8f9de0b4cc8e tempest-VolumesActionsTest-1487175399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5ab3b754-74e1-4e45-840a-afb7e6e586fa {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-949648cd-b30f-4d8b-9860-8f9de0b4cc8e tempest-VolumesActionsTest-1487175399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5ab3b754-74e1-4e45-840a-afb7e6e586fa" returned: 0 in 0.481s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-949648cd-b30f-4d8b-9860-8f9de0b4cc8e tempest-VolumesActionsTest-1487175399 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5ab3b754-74e1-4e45-840a-afb7e6e586fa {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-949648cd-b30f-4d8b-9860-8f9de0b4cc8e tempest-VolumesActionsTest-1487175399 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5ab3b754-74e1-4e45-840a-afb7e6e586fa" returned: 0 in 0.097s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:35 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-949648cd-b30f-4d8b-9860-8f9de0b4cc8e tempest-VolumesActionsTest-1487175399 None] Lock "cinder-quobyte-5ab3b754-74e1-4e45-840a-afb7e6e586fa" released by "delete_volume" :: held 0.752s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:52:35 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-949648cd-b30f-4d8b-9860-8f9de0b4cc8e tempest-VolumesActionsTest-1487175399 None] Created reservations ['d2661457-162c-46dd-b67a-b85a95b770cc', '6bf240e0-eed1-4231-a775-67bb2e69a504', '8f657a08-82d2-482c-8b8a-8d42448435ce', '6363fdb4-505a-4a08-b62f-35d5a4a64c97'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:52:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-949648cd-b30f-4d8b-9860-8f9de0b4cc8e tempest-VolumesActionsTest-1487175399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:52:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-949648cd-b30f-4d8b-9860-8f9de0b4cc8e tempest-VolumesActionsTest-1487175399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:52:35 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-949648cd-b30f-4d8b-9860-8f9de0b4cc8e tempest-VolumesActionsTest-1487175399 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:52:35 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-949648cd-b30f-4d8b-9860-8f9de0b4cc8e tempest-VolumesActionsTest-1487175399 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:52:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-949648cd-b30f-4d8b-9860-8f9de0b4cc8e tempest-VolumesActionsTest-1487175399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:52:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-949648cd-b30f-4d8b-9860-8f9de0b4cc8e tempest-VolumesActionsTest-1487175399 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-949648cd-b30f-4d8b-9860-8f9de0b4cc8e tempest-VolumesActionsTest-1487175399 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.097s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:36 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-949648cd-b30f-4d8b-9860-8f9de0b4cc8e tempest-VolumesActionsTest-1487175399 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:52:36 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-949648cd-b30f-4d8b-9860-8f9de0b4cc8e tempest-VolumesActionsTest-1487175399 None] Deleted volume successfully.
Sep 18 11:52:36 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-949648cd-b30f-4d8b-9860-8f9de0b4cc8e tempest-VolumesActionsTest-1487175399 None] Lock "cinder-5ab3b754-74e1-4e45-840a-afb7e6e586fa-delete_volume" released by "delete_volume" :: held 1.886s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:52:41 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-4a42087d-777b-465f-beaf-b63b74df2fba tempest-AbsoluteLimitsTests-2073258515 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:52:41 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a42087d-777b-465f-beaf-b63b74df2fba tempest-AbsoluteLimitsTests-2073258515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:52:41 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4a42087d-777b-465f-beaf-b63b74df2fba tempest-AbsoluteLimitsTests-2073258515 None] Flow 'volume_create_manager' (8e9b7983-3dba-4e4a-bf47-02c6205a4895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:52:41 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4a42087d-777b-465f-beaf-b63b74df2fba tempest-AbsoluteLimitsTests-2073258515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (489d0a24-f1bd-4420-8a53-dda2c13cc69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:41 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4a42087d-777b-465f-beaf-b63b74df2fba tempest-AbsoluteLimitsTests-2073258515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (489d0a24-f1bd-4420-8a53-dda2c13cc69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:52:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-415524689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e2bf524-41e0-4f1d-818f-a8264af37dcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d52efe1bebb4862b6c00c8988e76ba2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:52:41Z,use_quota=True,user_id='772e71f110c24970af207f2cdd6dc0b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:41 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4a42087d-777b-465f-beaf-b63b74df2fba tempest-AbsoluteLimitsTests-2073258515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43daf46f-b10e-4c57-8d6f-fb57a6d31c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:41 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4a42087d-777b-465f-beaf-b63b74df2fba tempest-AbsoluteLimitsTests-2073258515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43daf46f-b10e-4c57-8d6f-fb57a6d31c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:41 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4a42087d-777b-465f-beaf-b63b74df2fba tempest-AbsoluteLimitsTests-2073258515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (807a51b3-12fd-4d80-a31e-12889f2eef00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:41 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4a42087d-777b-465f-beaf-b63b74df2fba tempest-AbsoluteLimitsTests-2073258515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (807a51b3-12fd-4d80-a31e-12889f2eef00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e2bf524-41e0-4f1d-818f-a8264af37dcf', 'volume_name': 'volume-0e2bf524-41e0-4f1d-818f-a8264af37dcf', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:41 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4a42087d-777b-465f-beaf-b63b74df2fba tempest-AbsoluteLimitsTests-2073258515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b00ceaf-1025-438e-8d90-7755c5e9a88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:41 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4a42087d-777b-465f-beaf-b63b74df2fba tempest-AbsoluteLimitsTests-2073258515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b00ceaf-1025-438e-8d90-7755c5e9a88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:41 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4a42087d-777b-465f-beaf-b63b74df2fba tempest-AbsoluteLimitsTests-2073258515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc26bc40-f5fe-4f8d-9474-e9c55de3e8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:41 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-4a42087d-777b-465f-beaf-b63b74df2fba tempest-AbsoluteLimitsTests-2073258515 None] Volume 0e2bf524-41e0-4f1d-818f-a8264af37dcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e2bf524-41e0-4f1d-818f-a8264af37dcf', 'volume_size': 1}
Sep 18 11:52:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4a42087d-777b-465f-beaf-b63b74df2fba tempest-AbsoluteLimitsTests-2073258515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:52:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4a42087d-777b-465f-beaf-b63b74df2fba tempest-AbsoluteLimitsTests-2073258515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:52:41 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-4a42087d-777b-465f-beaf-b63b74df2fba tempest-AbsoluteLimitsTests-2073258515 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:52:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-415524689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e2bf524-41e0-4f1d-818f-a8264af37dcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d52efe1bebb4862b6c00c8988e76ba2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:52:41Z,use_quota=True,user_id='772e71f110c24970af207f2cdd6dc0b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:52:41 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-4a42087d-777b-465f-beaf-b63b74df2fba tempest-AbsoluteLimitsTests-2073258515 None] Creating volume 0e2bf524-41e0-4f1d-818f-a8264af37dcf {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:52:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4a42087d-777b-465f-beaf-b63b74df2fba tempest-AbsoluteLimitsTests-2073258515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:52:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4a42087d-777b-465f-beaf-b63b74df2fba tempest-AbsoluteLimitsTests-2073258515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:52:41 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-4a42087d-777b-465f-beaf-b63b74df2fba tempest-AbsoluteLimitsTests-2073258515 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:52:41 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-4a42087d-777b-465f-beaf-b63b74df2fba tempest-AbsoluteLimitsTests-2073258515 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:52:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4a42087d-777b-465f-beaf-b63b74df2fba tempest-AbsoluteLimitsTests-2073258515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:52:41 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-4a42087d-777b-465f-beaf-b63b74df2fba tempest-AbsoluteLimitsTests-2073258515 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:52:41 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-4a42087d-777b-465f-beaf-b63b74df2fba tempest-AbsoluteLimitsTests-2073258515 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:52:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4a42087d-777b-465f-beaf-b63b74df2fba tempest-AbsoluteLimitsTests-2073258515 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-0e2bf524-41e0-4f1d-818f-a8264af37dcf 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:42 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=95, name=volume-0e2bf524-41e0-4f1d-818f-a8264af37dcf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:52:42 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4a42087d-777b-465f-beaf-b63b74df2fba tempest-AbsoluteLimitsTests-2073258515 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-0e2bf524-41e0-4f1d-818f-a8264af37dcf 1073741824" returned: 0 in 0.557s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:42 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4a42087d-777b-465f-beaf-b63b74df2fba tempest-AbsoluteLimitsTests-2073258515 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-0e2bf524-41e0-4f1d-818f-a8264af37dcf {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:42 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4a42087d-777b-465f-beaf-b63b74df2fba tempest-AbsoluteLimitsTests-2073258515 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-0e2bf524-41e0-4f1d-818f-a8264af37dcf" returned: 0 in 0.142s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:42 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-4a42087d-777b-465f-beaf-b63b74df2fba tempest-AbsoluteLimitsTests-2073258515 None] <== create_volume: return (800ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:52:42 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4a42087d-777b-465f-beaf-b63b74df2fba tempest-AbsoluteLimitsTests-2073258515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:52:42 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4a42087d-777b-465f-beaf-b63b74df2fba tempest-AbsoluteLimitsTests-2073258515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc26bc40-f5fe-4f8d-9474-e9c55de3e8ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e2bf524-41e0-4f1d-818f-a8264af37dcf', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:42 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4a42087d-777b-465f-beaf-b63b74df2fba tempest-AbsoluteLimitsTests-2073258515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbed1747-2a5a-4535-a2f1-5786d43095d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:43 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-4a42087d-777b-465f-beaf-b63b74df2fba tempest-AbsoluteLimitsTests-2073258515 None] Volume volume-0e2bf524-41e0-4f1d-818f-a8264af37dcf (0e2bf524-41e0-4f1d-818f-a8264af37dcf): created successfully
Sep 18 11:52:43 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4a42087d-777b-465f-beaf-b63b74df2fba tempest-AbsoluteLimitsTests-2073258515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbed1747-2a5a-4535-a2f1-5786d43095d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:43 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4a42087d-777b-465f-beaf-b63b74df2fba tempest-AbsoluteLimitsTests-2073258515 None] Flow 'volume_create_manager' (8e9b7983-3dba-4e4a-bf47-02c6205a4895) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:52:43 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-4a42087d-777b-465f-beaf-b63b74df2fba tempest-AbsoluteLimitsTests-2073258515 None] Created volume successfully.
Sep 18 11:52:43 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ad603f8c-a411-49fd-9724-ede83c1af530 tempest-AbsoluteLimitsTests-2073258515 None] Acquiring lock "cinder-0e2bf524-41e0-4f1d-818f-a8264af37dcf-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:52:44 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ad603f8c-a411-49fd-9724-ede83c1af530 tempest-AbsoluteLimitsTests-2073258515 None] Lock "cinder-0e2bf524-41e0-4f1d-818f-a8264af37dcf-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:52:44 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-ad603f8c-a411-49fd-9724-ede83c1af530 tempest-AbsoluteLimitsTests-2073258515 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:52:44 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ad603f8c-a411-49fd-9724-ede83c1af530 tempest-AbsoluteLimitsTests-2073258515 None] Acquiring lock "cinder-quobyte-0e2bf524-41e0-4f1d-818f-a8264af37dcf" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:52:44 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ad603f8c-a411-49fd-9724-ede83c1af530 tempest-AbsoluteLimitsTests-2073258515 None] Lock "cinder-quobyte-0e2bf524-41e0-4f1d-818f-a8264af37dcf" acquired by "delete_volume" :: waited 0.015s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:52:44 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf7337a-8a43-4596-ad3e-124503a5f787]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:52:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ad603f8c-a411-49fd-9724-ede83c1af530 tempest-AbsoluteLimitsTests-2073258515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-0e2bf524-41e0-4f1d-818f-a8264af37dcf {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ad603f8c-a411-49fd-9724-ede83c1af530 tempest-AbsoluteLimitsTests-2073258515 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-0e2bf524-41e0-4f1d-818f-a8264af37dcf" returned: 0 in 0.537s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ad603f8c-a411-49fd-9724-ede83c1af530 tempest-AbsoluteLimitsTests-2073258515 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-0e2bf524-41e0-4f1d-818f-a8264af37dcf {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ad603f8c-a411-49fd-9724-ede83c1af530 tempest-AbsoluteLimitsTests-2073258515 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-0e2bf524-41e0-4f1d-818f-a8264af37dcf" returned: 0 in 0.109s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:45 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ad603f8c-a411-49fd-9724-ede83c1af530 tempest-AbsoluteLimitsTests-2073258515 None] Lock "cinder-quobyte-0e2bf524-41e0-4f1d-818f-a8264af37dcf" released by "delete_volume" :: held 0.832s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:52:45 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-ad603f8c-a411-49fd-9724-ede83c1af530 tempest-AbsoluteLimitsTests-2073258515 None] Created reservations ['a6d9ade6-9859-4246-b241-43dd9a41d92e', 'a7f94353-8aaa-40ae-b1d3-4b3e5cf477dd', '77fddcc5-441c-4259-b492-75c57d45c000', '03828d1a-17b2-40d4-aa57-20b47a23e9f1'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:52:45 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ad603f8c-a411-49fd-9724-ede83c1af530 tempest-AbsoluteLimitsTests-2073258515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:52:45 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ad603f8c-a411-49fd-9724-ede83c1af530 tempest-AbsoluteLimitsTests-2073258515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:52:45 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-ad603f8c-a411-49fd-9724-ede83c1af530 tempest-AbsoluteLimitsTests-2073258515 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:52:45 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-ad603f8c-a411-49fd-9724-ede83c1af530 tempest-AbsoluteLimitsTests-2073258515 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:52:45 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ad603f8c-a411-49fd-9724-ede83c1af530 tempest-AbsoluteLimitsTests-2073258515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:52:45 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ad603f8c-a411-49fd-9724-ede83c1af530 tempest-AbsoluteLimitsTests-2073258515 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:45 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ad603f8c-a411-49fd-9724-ede83c1af530 tempest-AbsoluteLimitsTests-2073258515 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.118s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:45 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-ad603f8c-a411-49fd-9724-ede83c1af530 tempest-AbsoluteLimitsTests-2073258515 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:52:45 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-ad603f8c-a411-49fd-9724-ede83c1af530 tempest-AbsoluteLimitsTests-2073258515 None] Deleted volume successfully.
Sep 18 11:52:45 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ad603f8c-a411-49fd-9724-ede83c1af530 tempest-AbsoluteLimitsTests-2073258515 None] Lock "cinder-0e2bf524-41e0-4f1d-818f-a8264af37dcf-delete_volume" released by "delete_volume" :: held 1.877s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:52:52 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-17127aa7-cbd2-4372-b43d-c1f905c82a3e tempest-VolumesDeleteCascade-63270987 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:52:52 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-17127aa7-cbd2-4372-b43d-c1f905c82a3e tempest-VolumesDeleteCascade-63270987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:52:52 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-17127aa7-cbd2-4372-b43d-c1f905c82a3e tempest-VolumesDeleteCascade-63270987 None] Flow 'volume_create_manager' (6d5f68ca-1100-4c32-acd6-055104088e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:52:52 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-17127aa7-cbd2-4372-b43d-c1f905c82a3e tempest-VolumesDeleteCascade-63270987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb60f3d7-8cfd-444a-920c-1d3402f056ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:52 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-17127aa7-cbd2-4372-b43d-c1f905c82a3e tempest-VolumesDeleteCascade-63270987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb60f3d7-8cfd-444a-920c-1d3402f056ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1345180267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1138e786-8293-4d73-be7e-1049822dde35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65ab19eea2ec48029824cb3936c31e33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:52:52Z,use_quota=True,user_id='74482b8b38054e10b2535732a998928f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:52 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-17127aa7-cbd2-4372-b43d-c1f905c82a3e tempest-VolumesDeleteCascade-63270987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93a613fc-fd12-4744-9456-4562af4cd2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:52 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-17127aa7-cbd2-4372-b43d-c1f905c82a3e tempest-VolumesDeleteCascade-63270987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93a613fc-fd12-4744-9456-4562af4cd2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:52 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-17127aa7-cbd2-4372-b43d-c1f905c82a3e tempest-VolumesDeleteCascade-63270987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee7d9144-1ac2-4b35-915c-b18d5390d709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:52 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-17127aa7-cbd2-4372-b43d-c1f905c82a3e tempest-VolumesDeleteCascade-63270987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee7d9144-1ac2-4b35-915c-b18d5390d709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1138e786-8293-4d73-be7e-1049822dde35', 'volume_name': 'volume-1138e786-8293-4d73-be7e-1049822dde35', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:52 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-17127aa7-cbd2-4372-b43d-c1f905c82a3e tempest-VolumesDeleteCascade-63270987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c725b87-5d3e-4c14-abb1-120308280957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:52 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-17127aa7-cbd2-4372-b43d-c1f905c82a3e tempest-VolumesDeleteCascade-63270987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c725b87-5d3e-4c14-abb1-120308280957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:52 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-17127aa7-cbd2-4372-b43d-c1f905c82a3e tempest-VolumesDeleteCascade-63270987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17619960-c820-4b43-8af5-fe746876f6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:52 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-17127aa7-cbd2-4372-b43d-c1f905c82a3e tempest-VolumesDeleteCascade-63270987 None] Volume 1138e786-8293-4d73-be7e-1049822dde35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1138e786-8293-4d73-be7e-1049822dde35', 'volume_size': 1}
Sep 18 11:52:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-17127aa7-cbd2-4372-b43d-c1f905c82a3e tempest-VolumesDeleteCascade-63270987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:52:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-17127aa7-cbd2-4372-b43d-c1f905c82a3e tempest-VolumesDeleteCascade-63270987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:52:52 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-17127aa7-cbd2-4372-b43d-c1f905c82a3e tempest-VolumesDeleteCascade-63270987 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1345180267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1138e786-8293-4d73-be7e-1049822dde35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65ab19eea2ec48029824cb3936c31e33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:52:52Z,use_quota=True,user_id='74482b8b38054e10b2535732a998928f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:52:52 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-17127aa7-cbd2-4372-b43d-c1f905c82a3e tempest-VolumesDeleteCascade-63270987 None] Creating volume 1138e786-8293-4d73-be7e-1049822dde35 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:52:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-17127aa7-cbd2-4372-b43d-c1f905c82a3e tempest-VolumesDeleteCascade-63270987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:52:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-17127aa7-cbd2-4372-b43d-c1f905c82a3e tempest-VolumesDeleteCascade-63270987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:52:52 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-17127aa7-cbd2-4372-b43d-c1f905c82a3e tempest-VolumesDeleteCascade-63270987 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:52:52 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-17127aa7-cbd2-4372-b43d-c1f905c82a3e tempest-VolumesDeleteCascade-63270987 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:52:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-17127aa7-cbd2-4372-b43d-c1f905c82a3e tempest-VolumesDeleteCascade-63270987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:52:52 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-17127aa7-cbd2-4372-b43d-c1f905c82a3e tempest-VolumesDeleteCascade-63270987 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:52:52 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-17127aa7-cbd2-4372-b43d-c1f905c82a3e tempest-VolumesDeleteCascade-63270987 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:52:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-17127aa7-cbd2-4372-b43d-c1f905c82a3e tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:52 devstack quobyte-client[83193]: System call of process 94789 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:52:52 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=96, name=volume-1138e786-8293-4d73-be7e-1049822dde35, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:52:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-17127aa7-cbd2-4372-b43d-c1f905c82a3e tempest-VolumesDeleteCascade-63270987 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35 1073741824" returned: 0 in 0.419s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-17127aa7-cbd2-4372-b43d-c1f905c82a3e tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-17127aa7-cbd2-4372-b43d-c1f905c82a3e tempest-VolumesDeleteCascade-63270987 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35" returned: 0 in 0.095s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:52 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-17127aa7-cbd2-4372-b43d-c1f905c82a3e tempest-VolumesDeleteCascade-63270987 None] <== create_volume: return (604ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:52:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-17127aa7-cbd2-4372-b43d-c1f905c82a3e tempest-VolumesDeleteCascade-63270987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.627s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:52:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-17127aa7-cbd2-4372-b43d-c1f905c82a3e tempest-VolumesDeleteCascade-63270987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17619960-c820-4b43-8af5-fe746876f6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1138e786-8293-4d73-be7e-1049822dde35', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-17127aa7-cbd2-4372-b43d-c1f905c82a3e tempest-VolumesDeleteCascade-63270987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fb4191f-6d10-487d-8912-e0c3b2727b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:53 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-17127aa7-cbd2-4372-b43d-c1f905c82a3e tempest-VolumesDeleteCascade-63270987 None] Volume volume-1138e786-8293-4d73-be7e-1049822dde35 (1138e786-8293-4d73-be7e-1049822dde35): created successfully
Sep 18 11:52:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-17127aa7-cbd2-4372-b43d-c1f905c82a3e tempest-VolumesDeleteCascade-63270987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fb4191f-6d10-487d-8912-e0c3b2727b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-17127aa7-cbd2-4372-b43d-c1f905c82a3e tempest-VolumesDeleteCascade-63270987 None] Flow 'volume_create_manager' (6d5f68ca-1100-4c32-acd6-055104088e74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:52:53 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-17127aa7-cbd2-4372-b43d-c1f905c82a3e tempest-VolumesDeleteCascade-63270987 None] Created volume successfully.
Sep 18 11:52:54 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-5a37f187-80e7-40f3-b8f5-ca25f945afcb tempest-VolumesDeleteCascade-63270987 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:52:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-5a37f187-80e7-40f3-b8f5-ca25f945afcb tempest-VolumesDeleteCascade-63270987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:52:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-5a37f187-80e7-40f3-b8f5-ca25f945afcb tempest-VolumesDeleteCascade-63270987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:52:54 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-5a37f187-80e7-40f3-b8f5-ca25f945afcb tempest-VolumesDeleteCascade-63270987 None] Creating offline snapshot 900da477-f536-4546-b752-a09fd1470f44 of volume 1138e786-8293-4d73-be7e-1049822dde35 {{(pid=83176) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 11:52:54 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[55582cb2-1f66-429f-82c7-978c3255277f]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:52:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5a37f187-80e7-40f3-b8f5-ca25f945afcb tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5a37f187-80e7-40f3-b8f5-ca25f945afcb tempest-VolumesDeleteCascade-63270987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35" returned: 0 in 0.473s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5a37f187-80e7-40f3-b8f5-ca25f945afcb tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.900da477-f536-4546-b752-a09fd1470f44 1G {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:55 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=97, name=volume-1138e786-8293-4d73-be7e-1049822dde35.900da477-f536-4546-b752-a09fd1470f44, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:52:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5a37f187-80e7-40f3-b8f5-ca25f945afcb tempest-VolumesDeleteCascade-63270987 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.900da477-f536-4546-b752-a09fd1470f44 1G" returned: 0 in 0.257s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5a37f187-80e7-40f3-b8f5-ca25f945afcb tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): qemu-img rebase -u -b volume-1138e786-8293-4d73-be7e-1049822dde35 -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.900da477-f536-4546-b752-a09fd1470f44 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:55 devstack quobyte-client[83193]: System call of process 94800 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:52:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5a37f187-80e7-40f3-b8f5-ca25f945afcb tempest-VolumesDeleteCascade-63270987 None] CMD "qemu-img rebase -u -b volume-1138e786-8293-4d73-be7e-1049822dde35 -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.900da477-f536-4546-b752-a09fd1470f44" returned: 0 in 0.152s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:55 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-5a37f187-80e7-40f3-b8f5-ca25f945afcb tempest-VolumesDeleteCascade-63270987 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.900da477-f536-4546-b752-a09fd1470f44 is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 11:52:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5a37f187-80e7-40f3-b8f5-ca25f945afcb tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.900da477-f536-4546-b752-a09fd1470f44 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5a37f187-80e7-40f3-b8f5-ca25f945afcb tempest-VolumesDeleteCascade-63270987 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.900da477-f536-4546-b752-a09fd1470f44" returned: 0 in 0.117s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:55 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-5a37f187-80e7-40f3-b8f5-ca25f945afcb tempest-VolumesDeleteCascade-63270987 None] Setting permissions: /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35 -> 1000:1000 {{(pid=83176) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 11:52:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5a37f187-80e7-40f3-b8f5-ca25f945afcb tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.900da477-f536-4546-b752-a09fd1470f44 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5a37f187-80e7-40f3-b8f5-ca25f945afcb tempest-VolumesDeleteCascade-63270987 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.900da477-f536-4546-b752-a09fd1470f44" returned: 0 in 0.109s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5a37f187-80e7-40f3-b8f5-ca25f945afcb tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.info {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:56 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5a37f187-80e7-40f3-b8f5-ca25f945afcb tempest-VolumesDeleteCascade-63270987 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.info" returned: 0 in 0.092s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:56 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-5a37f187-80e7-40f3-b8f5-ca25f945afcb tempest-VolumesDeleteCascade-63270987 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.info is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 11:52:56 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5a37f187-80e7-40f3-b8f5-ca25f945afcb tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.info {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:56 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5a37f187-80e7-40f3-b8f5-ca25f945afcb tempest-VolumesDeleteCascade-63270987 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.info" returned: 0 in 0.090s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:56 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-5a37f187-80e7-40f3-b8f5-ca25f945afcb tempest-VolumesDeleteCascade-63270987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.641s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:52:56 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-5a37f187-80e7-40f3-b8f5-ca25f945afcb tempest-VolumesDeleteCascade-63270987 None] Create snapshot completed successfully
Sep 18 11:52:57 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-87865da9-b401-48f2-8bfc-b65c68a830a9 tempest-VolumesTransfersV355Test-570981965 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:52:57 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-87865da9-b401-48f2-8bfc-b65c68a830a9 tempest-VolumesTransfersV355Test-570981965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:52:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-87865da9-b401-48f2-8bfc-b65c68a830a9 tempest-VolumesTransfersV355Test-570981965 None] Flow 'volume_create_manager' (fd01a30b-b9c8-41b4-93bf-ef101bb2b8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:52:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-87865da9-b401-48f2-8bfc-b65c68a830a9 tempest-VolumesTransfersV355Test-570981965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b831da6-f907-4915-800e-5ebcca18676f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-87865da9-b401-48f2-8bfc-b65c68a830a9 tempest-VolumesTransfersV355Test-570981965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b831da6-f907-4915-800e-5ebcca18676f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-393407612',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d54186-cb8c-45c6-9c90-b9abc7b7af28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9daccfee54f4185883dc72631b384b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:52:57Z,use_quota=True,user_id='92990af4cba74d609fea7242fcf4a5c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-87865da9-b401-48f2-8bfc-b65c68a830a9 tempest-VolumesTransfersV355Test-570981965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02ffba27-f84a-4ba0-a684-0e7a656cc6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-87865da9-b401-48f2-8bfc-b65c68a830a9 tempest-VolumesTransfersV355Test-570981965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02ffba27-f84a-4ba0-a684-0e7a656cc6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-87865da9-b401-48f2-8bfc-b65c68a830a9 tempest-VolumesTransfersV355Test-570981965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2509c465-fec4-41bd-ba7e-b5c85b6e8638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-87865da9-b401-48f2-8bfc-b65c68a830a9 tempest-VolumesTransfersV355Test-570981965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2509c465-fec4-41bd-ba7e-b5c85b6e8638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36d54186-cb8c-45c6-9c90-b9abc7b7af28', 'volume_name': 'volume-36d54186-cb8c-45c6-9c90-b9abc7b7af28', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-87865da9-b401-48f2-8bfc-b65c68a830a9 tempest-VolumesTransfersV355Test-570981965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (565fe4c6-a607-4bc6-8442-6d36f50c78c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-87865da9-b401-48f2-8bfc-b65c68a830a9 tempest-VolumesTransfersV355Test-570981965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (565fe4c6-a607-4bc6-8442-6d36f50c78c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-87865da9-b401-48f2-8bfc-b65c68a830a9 tempest-VolumesTransfersV355Test-570981965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcb28d27-99c5-45ca-94ec-54ee7496318e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:57 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-87865da9-b401-48f2-8bfc-b65c68a830a9 tempest-VolumesTransfersV355Test-570981965 None] Volume 36d54186-cb8c-45c6-9c90-b9abc7b7af28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36d54186-cb8c-45c6-9c90-b9abc7b7af28', 'volume_size': 1}
Sep 18 11:52:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-87865da9-b401-48f2-8bfc-b65c68a830a9 tempest-VolumesTransfersV355Test-570981965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:52:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-87865da9-b401-48f2-8bfc-b65c68a830a9 tempest-VolumesTransfersV355Test-570981965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:52:57 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-87865da9-b401-48f2-8bfc-b65c68a830a9 tempest-VolumesTransfersV355Test-570981965 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-393407612',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d54186-cb8c-45c6-9c90-b9abc7b7af28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9daccfee54f4185883dc72631b384b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:52:57Z,use_quota=True,user_id='92990af4cba74d609fea7242fcf4a5c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:52:57 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-87865da9-b401-48f2-8bfc-b65c68a830a9 tempest-VolumesTransfersV355Test-570981965 None] Creating volume 36d54186-cb8c-45c6-9c90-b9abc7b7af28 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:52:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-87865da9-b401-48f2-8bfc-b65c68a830a9 tempest-VolumesTransfersV355Test-570981965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:52:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-87865da9-b401-48f2-8bfc-b65c68a830a9 tempest-VolumesTransfersV355Test-570981965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:52:57 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-87865da9-b401-48f2-8bfc-b65c68a830a9 tempest-VolumesTransfersV355Test-570981965 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:52:57 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-87865da9-b401-48f2-8bfc-b65c68a830a9 tempest-VolumesTransfersV355Test-570981965 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:52:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-87865da9-b401-48f2-8bfc-b65c68a830a9 tempest-VolumesTransfersV355Test-570981965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:52:57 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-87865da9-b401-48f2-8bfc-b65c68a830a9 tempest-VolumesTransfersV355Test-570981965 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:52:57 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-87865da9-b401-48f2-8bfc-b65c68a830a9 tempest-VolumesTransfersV355Test-570981965 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:52:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-87865da9-b401-48f2-8bfc-b65c68a830a9 tempest-VolumesTransfersV355Test-570981965 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-36d54186-cb8c-45c6-9c90-b9abc7b7af28 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:57 devstack quobyte-client[83193]: System call of process 94807 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:52:57 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=99, name=volume-36d54186-cb8c-45c6-9c90-b9abc7b7af28, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:52:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-87865da9-b401-48f2-8bfc-b65c68a830a9 tempest-VolumesTransfersV355Test-570981965 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-36d54186-cb8c-45c6-9c90-b9abc7b7af28 1073741824" returned: 0 in 0.468s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-87865da9-b401-48f2-8bfc-b65c68a830a9 tempest-VolumesTransfersV355Test-570981965 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-36d54186-cb8c-45c6-9c90-b9abc7b7af28 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:58 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-68f82c1a-42ce-42c6-9a34-f6f4a874db86 tempest-VolumesDeleteCascade-63270987 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:52:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-68f82c1a-42ce-42c6-9a34-f6f4a874db86 tempest-VolumesDeleteCascade-63270987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:52:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-87865da9-b401-48f2-8bfc-b65c68a830a9 tempest-VolumesTransfersV355Test-570981965 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-36d54186-cb8c-45c6-9c90-b9abc7b7af28" returned: 0 in 0.152s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:58 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-87865da9-b401-48f2-8bfc-b65c68a830a9 tempest-VolumesTransfersV355Test-570981965 None] <== create_volume: return (649ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:52:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-87865da9-b401-48f2-8bfc-b65c68a830a9 tempest-VolumesTransfersV355Test-570981965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.657s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:52:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-68f82c1a-42ce-42c6-9a34-f6f4a874db86 tempest-VolumesDeleteCascade-63270987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.123s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:52:58 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-68f82c1a-42ce-42c6-9a34-f6f4a874db86 tempest-VolumesDeleteCascade-63270987 None] Creating offline snapshot dfa417c7-b132-4e47-919e-addb2270dd3b of volume 1138e786-8293-4d73-be7e-1049822dde35 {{(pid=83176) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 11:52:58 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-87865da9-b401-48f2-8bfc-b65c68a830a9 tempest-VolumesTransfersV355Test-570981965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcb28d27-99c5-45ca-94ec-54ee7496318e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36d54186-cb8c-45c6-9c90-b9abc7b7af28', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:58 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-87865da9-b401-48f2-8bfc-b65c68a830a9 tempest-VolumesTransfersV355Test-570981965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae1ae906-34bc-4708-a3c0-f6f23ccb2258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:52:58 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bb228d-c27e-4134-b955-7253afd970ff]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:52:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-68f82c1a-42ce-42c6-9a34-f6f4a874db86 tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.900da477-f536-4546-b752-a09fd1470f44 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:58 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-87865da9-b401-48f2-8bfc-b65c68a830a9 tempest-VolumesTransfersV355Test-570981965 None] Volume volume-36d54186-cb8c-45c6-9c90-b9abc7b7af28 (36d54186-cb8c-45c6-9c90-b9abc7b7af28): created successfully
Sep 18 11:52:58 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-87865da9-b401-48f2-8bfc-b65c68a830a9 tempest-VolumesTransfersV355Test-570981965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae1ae906-34bc-4708-a3c0-f6f23ccb2258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:52:58 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-87865da9-b401-48f2-8bfc-b65c68a830a9 tempest-VolumesTransfersV355Test-570981965 None] Flow 'volume_create_manager' (fd01a30b-b9c8-41b4-93bf-ef101bb2b8ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:52:59 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-87865da9-b401-48f2-8bfc-b65c68a830a9 tempest-VolumesTransfersV355Test-570981965 None] Created volume successfully.
Sep 18 11:52:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-68f82c1a-42ce-42c6-9a34-f6f4a874db86 tempest-VolumesDeleteCascade-63270987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.900da477-f536-4546-b752-a09fd1470f44" returned: 0 in 0.516s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:59 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-68f82c1a-42ce-42c6-9a34-f6f4a874db86 tempest-VolumesDeleteCascade-63270987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1138e786-8293-4d73-be7e-1049822dde35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 11:52:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-68f82c1a-42ce-42c6-9a34-f6f4a874db86 tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.900da477-f536-4546-b752-a09fd1470f44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.dfa417c7-b132-4e47-919e-addb2270dd3b 1G {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:59 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=100, name=volume-1138e786-8293-4d73-be7e-1049822dde35.dfa417c7-b132-4e47-919e-addb2270dd3b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:52:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-68f82c1a-42ce-42c6-9a34-f6f4a874db86 tempest-VolumesDeleteCascade-63270987 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.900da477-f536-4546-b752-a09fd1470f44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.dfa417c7-b132-4e47-919e-addb2270dd3b 1G" returned: 0 in 0.261s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-68f82c1a-42ce-42c6-9a34-f6f4a874db86 tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): qemu-img rebase -u -b volume-1138e786-8293-4d73-be7e-1049822dde35.900da477-f536-4546-b752-a09fd1470f44 -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.dfa417c7-b132-4e47-919e-addb2270dd3b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:59 devstack quobyte-client[83193]: System call of process 94817 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:52:59 devstack quobyte-client[83193]: System call of process 94817 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:52:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-68f82c1a-42ce-42c6-9a34-f6f4a874db86 tempest-VolumesDeleteCascade-63270987 None] CMD "qemu-img rebase -u -b volume-1138e786-8293-4d73-be7e-1049822dde35.900da477-f536-4546-b752-a09fd1470f44 -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.dfa417c7-b132-4e47-919e-addb2270dd3b" returned: 0 in 0.150s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:59 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-68f82c1a-42ce-42c6-9a34-f6f4a874db86 tempest-VolumesDeleteCascade-63270987 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.dfa417c7-b132-4e47-919e-addb2270dd3b is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 11:52:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-68f82c1a-42ce-42c6-9a34-f6f4a874db86 tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.dfa417c7-b132-4e47-919e-addb2270dd3b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-68f82c1a-42ce-42c6-9a34-f6f4a874db86 tempest-VolumesDeleteCascade-63270987 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.dfa417c7-b132-4e47-919e-addb2270dd3b" returned: 0 in 0.094s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:52:59 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-68f82c1a-42ce-42c6-9a34-f6f4a874db86 tempest-VolumesDeleteCascade-63270987 None] Setting permissions: /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.900da477-f536-4546-b752-a09fd1470f44 -> 1000:1000 {{(pid=83176) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 11:52:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-68f82c1a-42ce-42c6-9a34-f6f4a874db86 tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.900da477-f536-4546-b752-a09fd1470f44 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.dfa417c7-b132-4e47-919e-addb2270dd3b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:52:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-68f82c1a-42ce-42c6-9a34-f6f4a874db86 tempest-VolumesDeleteCascade-63270987 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.900da477-f536-4546-b752-a09fd1470f44 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.dfa417c7-b132-4e47-919e-addb2270dd3b" returned: 0 in 0.105s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-68f82c1a-42ce-42c6-9a34-f6f4a874db86 tempest-VolumesDeleteCascade-63270987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.510s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:53:00 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-68f82c1a-42ce-42c6-9a34-f6f4a874db86 tempest-VolumesDeleteCascade-63270987 None] Create snapshot completed successfully
Sep 18 11:53:00 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-f708b318-2f72-4b5b-873a-3422903e5fd1 tempest-VolumesTransfersV355Test-1637463934 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:53:00 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-f708b318-2f72-4b5b-873a-3422903e5fd1 tempest-VolumesTransfersV355Test-1637463934 None] Transfer volume completed successfully.
Sep 18 11:53:01 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Acquiring lock "cinder-1138e786-8293-4d73-be7e-1049822dde35-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:53:01 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Lock "cinder-1138e786-8293-4d73-be7e-1049822dde35-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:53:01 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:53:01 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Performing cascade delete. {{(pid=83176) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 18 11:53:01 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-e6b939cc-8dbf-4211-9d37-72e44e5674eb tempest-VolumesTransfersV355Test-933351461 None] Acquiring lock "cinder-36d54186-cb8c-45c6-9c90-b9abc7b7af28-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:53:01 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Acquiring lock "cinder-900da477-f536-4546-b752-a09fd1470f44-delete_snapshot" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:53:01 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-e6b939cc-8dbf-4211-9d37-72e44e5674eb tempest-VolumesTransfersV355Test-933351461 None] Lock "cinder-36d54186-cb8c-45c6-9c90-b9abc7b7af28-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:53:01 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Lock "cinder-900da477-f536-4546-b752-a09fd1470f44-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:53:01 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:53:01 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Acquiring lock "cinder-quobyte-1138e786-8293-4d73-be7e-1049822dde35" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:53:01 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Lock "cinder-quobyte-1138e786-8293-4d73-be7e-1049822dde35" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:53:01 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Acquiring lock "cinder-quobyte-900da477-f536-4546-b752-a09fd1470f44" by "_delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:53:01 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-e6b939cc-8dbf-4211-9d37-72e44e5674eb tempest-VolumesTransfersV355Test-933351461 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:53:01 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-e6b939cc-8dbf-4211-9d37-72e44e5674eb tempest-VolumesTransfersV355Test-933351461 None] Acquiring lock "cinder-quobyte-36d54186-cb8c-45c6-9c90-b9abc7b7af28" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:53:01 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Lock "cinder-quobyte-900da477-f536-4546-b752-a09fd1470f44" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:53:01 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Deleting offline snapshot 900da477-f536-4546-b752-a09fd1470f44 of volume 1138e786-8293-4d73-be7e-1049822dde35 {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 11:53:01 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] snapshot_file for this snap is: volume-1138e786-8293-4d73-be7e-1049822dde35.900da477-f536-4546-b752-a09fd1470f44 {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 11:53:01 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1858ddbc-c858-4ac7-bab8-9a40901e6e40]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:53:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.900da477-f536-4546-b752-a09fd1470f44 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:01 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-e6b939cc-8dbf-4211-9d37-72e44e5674eb tempest-VolumesTransfersV355Test-933351461 None] Lock "cinder-quobyte-36d54186-cb8c-45c6-9c90-b9abc7b7af28" acquired by "delete_volume" :: waited 0.146s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:53:01 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd93d08-1a96-4a88-9b8c-e838fb2016f1]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:53:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-e6b939cc-8dbf-4211-9d37-72e44e5674eb tempest-VolumesTransfersV355Test-933351461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-36d54186-cb8c-45c6-9c90-b9abc7b7af28 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.900da477-f536-4546-b752-a09fd1470f44" returned: 0 in 0.473s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:02 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1138e786-8293-4d73-be7e-1049822dde35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 11:53:02 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[113c912c-c307-41f5-9094-7e6f5d542e5a]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:53:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-e6b939cc-8dbf-4211-9d37-72e44e5674eb tempest-VolumesTransfersV355Test-933351461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-36d54186-cb8c-45c6-9c90-b9abc7b7af28" returned: 0 in 0.541s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-e6b939cc-8dbf-4211-9d37-72e44e5674eb tempest-VolumesTransfersV355Test-933351461 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-36d54186-cb8c-45c6-9c90-b9abc7b7af28 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-e6b939cc-8dbf-4211-9d37-72e44e5674eb tempest-VolumesTransfersV355Test-933351461 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-36d54186-cb8c-45c6-9c90-b9abc7b7af28" returned: 0 in 0.117s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:02 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-e6b939cc-8dbf-4211-9d37-72e44e5674eb tempest-VolumesTransfersV355Test-933351461 None] Lock "cinder-quobyte-36d54186-cb8c-45c6-9c90-b9abc7b7af28" released by "delete_volume" :: held 0.928s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:53:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35" returned: 0 in 0.707s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:02 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a0ae41-7593-444e-954d-53259c7f3d2b]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:53:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.dfa417c7-b132-4e47-919e-addb2270dd3b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:03 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-e6b939cc-8dbf-4211-9d37-72e44e5674eb tempest-VolumesTransfersV355Test-933351461 None] Created reservations ['1807e537-9e03-4e0d-8495-99a38d069b6d', '6a3a7052-1030-4c3a-b60b-81590e40788e', '1f1e2231-5275-4860-af80-603582c578e3', 'c63b094a-f956-4725-a9e3-83e0e0cd6c70'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:53:03 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.dfa417c7-b132-4e47-919e-addb2270dd3b" returned: 0 in 0.482s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:03 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1138e786-8293-4d73-be7e-1049822dde35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 11:53:03 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-e6b939cc-8dbf-4211-9d37-72e44e5674eb tempest-VolumesTransfersV355Test-933351461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:53:03 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-e6b939cc-8dbf-4211-9d37-72e44e5674eb tempest-VolumesTransfersV355Test-933351461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:53:03 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-e6b939cc-8dbf-4211-9d37-72e44e5674eb tempest-VolumesTransfersV355Test-933351461 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:53:03 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-e6b939cc-8dbf-4211-9d37-72e44e5674eb tempest-VolumesTransfersV355Test-933351461 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:53:03 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-e6b939cc-8dbf-4211-9d37-72e44e5674eb tempest-VolumesTransfersV355Test-933351461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:53:03 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-e6b939cc-8dbf-4211-9d37-72e44e5674eb tempest-VolumesTransfersV355Test-933351461 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:03 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ab2b6f-ab19-43bb-9acd-95ac3fb3eccb]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:53:03 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.900da477-f536-4546-b752-a09fd1470f44 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:03 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-e6b939cc-8dbf-4211-9d37-72e44e5674eb tempest-VolumesTransfersV355Test-933351461 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.185s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:03 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-e6b939cc-8dbf-4211-9d37-72e44e5674eb tempest-VolumesTransfersV355Test-933351461 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:53:03 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-e6b939cc-8dbf-4211-9d37-72e44e5674eb tempest-VolumesTransfersV355Test-933351461 None] Deleted volume successfully.
Sep 18 11:53:04 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-e6b939cc-8dbf-4211-9d37-72e44e5674eb tempest-VolumesTransfersV355Test-933351461 None] Lock "cinder-36d54186-cb8c-45c6-9c90-b9abc7b7af28-delete_volume" released by "delete_volume" :: held 2.467s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:53:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.900da477-f536-4546-b752-a09fd1470f44" returned: 0 in 0.559s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:04 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1138e786-8293-4d73-be7e-1049822dde35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 11:53:04 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be1701b-81eb-43a1-ba9e-6c5256fbbff0]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:53:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35" returned: 0 in 0.594s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.900da477-f536-4546-b752-a09fd1470f44 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:04 devstack quobyte-client[83193]: System call of process 94848 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:53:05 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-79a6cb34-416d-446e-bb7c-091cf3aadd95 tempest-VolumesTransfersV355Test-570981965 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:53:05 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-79a6cb34-416d-446e-bb7c-091cf3aadd95 tempest-VolumesTransfersV355Test-570981965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:53:05 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-79a6cb34-416d-446e-bb7c-091cf3aadd95 tempest-VolumesTransfersV355Test-570981965 None] Flow 'volume_create_manager' (07072f2a-1fc3-46e7-ae8f-d9262cba6a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:53:05 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-79a6cb34-416d-446e-bb7c-091cf3aadd95 tempest-VolumesTransfersV355Test-570981965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (913754c7-78ca-4409-af3d-f792483d2815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.900da477-f536-4546-b752-a09fd1470f44" returned: 0 in 0.438s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.900da477-f536-4546-b752-a09fd1470f44 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:05 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-79a6cb34-416d-446e-bb7c-091cf3aadd95 tempest-VolumesTransfersV355Test-570981965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (913754c7-78ca-4409-af3d-f792483d2815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1861786181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45b223ea-0e2a-4a7d-ac5e-020d6d75987f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9daccfee54f4185883dc72631b384b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:53:04Z,use_quota=True,user_id='92990af4cba74d609fea7242fcf4a5c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:05 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-79a6cb34-416d-446e-bb7c-091cf3aadd95 tempest-VolumesTransfersV355Test-570981965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (834f281c-ef44-41f3-bc23-e5ecb0cbbffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:05 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-79a6cb34-416d-446e-bb7c-091cf3aadd95 tempest-VolumesTransfersV355Test-570981965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (834f281c-ef44-41f3-bc23-e5ecb0cbbffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:05 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-79a6cb34-416d-446e-bb7c-091cf3aadd95 tempest-VolumesTransfersV355Test-570981965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (754a7ff0-77f5-46b6-b1ee-81507a613149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:05 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-79a6cb34-416d-446e-bb7c-091cf3aadd95 tempest-VolumesTransfersV355Test-570981965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (754a7ff0-77f5-46b6-b1ee-81507a613149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45b223ea-0e2a-4a7d-ac5e-020d6d75987f', 'volume_name': 'volume-45b223ea-0e2a-4a7d-ac5e-020d6d75987f', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:05 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-79a6cb34-416d-446e-bb7c-091cf3aadd95 tempest-VolumesTransfersV355Test-570981965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d83f554-c891-412c-9521-04ec4efcfb2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:05 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-79a6cb34-416d-446e-bb7c-091cf3aadd95 tempest-VolumesTransfersV355Test-570981965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d83f554-c891-412c-9521-04ec4efcfb2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:05 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-79a6cb34-416d-446e-bb7c-091cf3aadd95 tempest-VolumesTransfersV355Test-570981965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f32cfc8-c139-4c81-8fea-e2cf8a73fbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:05 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-79a6cb34-416d-446e-bb7c-091cf3aadd95 tempest-VolumesTransfersV355Test-570981965 None] Volume 45b223ea-0e2a-4a7d-ac5e-020d6d75987f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45b223ea-0e2a-4a7d-ac5e-020d6d75987f', 'volume_size': 1}
Sep 18 11:53:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-79a6cb34-416d-446e-bb7c-091cf3aadd95 tempest-VolumesTransfersV355Test-570981965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:53:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-79a6cb34-416d-446e-bb7c-091cf3aadd95 tempest-VolumesTransfersV355Test-570981965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:53:05 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-79a6cb34-416d-446e-bb7c-091cf3aadd95 tempest-VolumesTransfersV355Test-570981965 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1861786181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45b223ea-0e2a-4a7d-ac5e-020d6d75987f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9daccfee54f4185883dc72631b384b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:53:04Z,use_quota=True,user_id='92990af4cba74d609fea7242fcf4a5c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:53:05 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-79a6cb34-416d-446e-bb7c-091cf3aadd95 tempest-VolumesTransfersV355Test-570981965 None] Creating volume 45b223ea-0e2a-4a7d-ac5e-020d6d75987f {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:53:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-79a6cb34-416d-446e-bb7c-091cf3aadd95 tempest-VolumesTransfersV355Test-570981965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:53:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-79a6cb34-416d-446e-bb7c-091cf3aadd95 tempest-VolumesTransfersV355Test-570981965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:53:05 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-79a6cb34-416d-446e-bb7c-091cf3aadd95 tempest-VolumesTransfersV355Test-570981965 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:53:05 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-79a6cb34-416d-446e-bb7c-091cf3aadd95 tempest-VolumesTransfersV355Test-570981965 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:53:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-79a6cb34-416d-446e-bb7c-091cf3aadd95 tempest-VolumesTransfersV355Test-570981965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:53:05 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-79a6cb34-416d-446e-bb7c-091cf3aadd95 tempest-VolumesTransfersV355Test-570981965 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:53:05 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-79a6cb34-416d-446e-bb7c-091cf3aadd95 tempest-VolumesTransfersV355Test-570981965 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:53:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-79a6cb34-416d-446e-bb7c-091cf3aadd95 tempest-VolumesTransfersV355Test-570981965 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-45b223ea-0e2a-4a7d-ac5e-020d6d75987f 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.900da477-f536-4546-b752-a09fd1470f44" returned: 0 in 0.437s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): qemu-img rebase -u -b volume-1138e786-8293-4d73-be7e-1049822dde35 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.dfa417c7-b132-4e47-919e-addb2270dd3b -F qcow2 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:05 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=101, name=volume-45b223ea-0e2a-4a7d-ac5e-020d6d75987f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:53:05 devstack quobyte-client[83193]: System call of process 94855 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:53:05 devstack quobyte-client[83193]: System call of process 94855 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:53:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] CMD "qemu-img rebase -u -b volume-1138e786-8293-4d73-be7e-1049822dde35 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.dfa417c7-b132-4e47-919e-addb2270dd3b -F qcow2" returned: 0 in 0.179s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:06 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Lock "cinder-quobyte-900da477-f536-4546-b752-a09fd1470f44" released by "_delete_snapshot" :: held 4.385s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:53:06 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-79a6cb34-416d-446e-bb7c-091cf3aadd95 tempest-VolumesTransfersV355Test-570981965 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-45b223ea-0e2a-4a7d-ac5e-020d6d75987f 1073741824" returned: 0 in 0.487s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:06 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-79a6cb34-416d-446e-bb7c-091cf3aadd95 tempest-VolumesTransfersV355Test-570981965 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-45b223ea-0e2a-4a7d-ac5e-020d6d75987f {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:06 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Lock "cinder-quobyte-1138e786-8293-4d73-be7e-1049822dde35" released by "delete_snapshot" :: held 4.536s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:53:06 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-79a6cb34-416d-446e-bb7c-091cf3aadd95 tempest-VolumesTransfersV355Test-570981965 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-45b223ea-0e2a-4a7d-ac5e-020d6d75987f" returned: 0 in 0.323s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:06 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-79a6cb34-416d-446e-bb7c-091cf3aadd95 tempest-VolumesTransfersV355Test-570981965 None] <== create_volume: return (839ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:53:06 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-79a6cb34-416d-446e-bb7c-091cf3aadd95 tempest-VolumesTransfersV355Test-570981965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:53:06 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-79a6cb34-416d-446e-bb7c-091cf3aadd95 tempest-VolumesTransfersV355Test-570981965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f32cfc8-c139-4c81-8fea-e2cf8a73fbc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45b223ea-0e2a-4a7d-ac5e-020d6d75987f', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:06 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-79a6cb34-416d-446e-bb7c-091cf3aadd95 tempest-VolumesTransfersV355Test-570981965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eb481cb-fad9-4359-af3e-3b8e22c1ace5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:06 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-79a6cb34-416d-446e-bb7c-091cf3aadd95 tempest-VolumesTransfersV355Test-570981965 None] Volume volume-45b223ea-0e2a-4a7d-ac5e-020d6d75987f (45b223ea-0e2a-4a7d-ac5e-020d6d75987f): created successfully
Sep 18 11:53:06 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-79a6cb34-416d-446e-bb7c-091cf3aadd95 tempest-VolumesTransfersV355Test-570981965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eb481cb-fad9-4359-af3e-3b8e22c1ace5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:06 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-79a6cb34-416d-446e-bb7c-091cf3aadd95 tempest-VolumesTransfersV355Test-570981965 None] Flow 'volume_create_manager' (07072f2a-1fc3-46e7-ae8f-d9262cba6a50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:53:06 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-79a6cb34-416d-446e-bb7c-091cf3aadd95 tempest-VolumesTransfersV355Test-570981965 None] Created volume successfully.
Sep 18 11:53:06 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Created reservations ['3c0e92b9-12fa-4f18-a591-bc8f8b0b751a', 'cb149a3b-e44e-4565-9554-b1b369de2dbb', '1009f251-3dc7-4aab-aae6-98c6e516c111', 'b6d3bb95-e0f3-4b30-ba53-ab2fd5c83d54'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:53:06 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Delete snapshot completed successfully.
Sep 18 11:53:06 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Lock "cinder-900da477-f536-4546-b752-a09fd1470f44-delete_snapshot" released by "delete_snapshot" :: held 5.289s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:53:06 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Acquiring lock "cinder-dfa417c7-b132-4e47-919e-addb2270dd3b-delete_snapshot" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:53:06 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Lock "cinder-dfa417c7-b132-4e47-919e-addb2270dd3b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:53:06 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:53:06 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Acquiring lock "cinder-quobyte-1138e786-8293-4d73-be7e-1049822dde35" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:53:06 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Lock "cinder-quobyte-1138e786-8293-4d73-be7e-1049822dde35" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:53:06 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Acquiring lock "cinder-quobyte-dfa417c7-b132-4e47-919e-addb2270dd3b" by "_delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:53:06 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Lock "cinder-quobyte-dfa417c7-b132-4e47-919e-addb2270dd3b" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:53:06 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Deleting offline snapshot dfa417c7-b132-4e47-919e-addb2270dd3b of volume 1138e786-8293-4d73-be7e-1049822dde35 {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 11:53:06 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] snapshot_file for this snap is: volume-1138e786-8293-4d73-be7e-1049822dde35.dfa417c7-b132-4e47-919e-addb2270dd3b {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 11:53:07 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bd48cd-ff7d-45f0-926e-ec4cd6cd1eed]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:53:07 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.dfa417c7-b132-4e47-919e-addb2270dd3b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:07 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.dfa417c7-b132-4e47-919e-addb2270dd3b" returned: 0 in 0.349s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:07 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1138e786-8293-4d73-be7e-1049822dde35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 11:53:07 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[24852d20-3c3b-472e-8154-dd0e973170fc]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:53:07 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:07 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35" returned: 0 in 0.445s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:07 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.dfa417c7-b132-4e47-919e-addb2270dd3b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.dfa417c7-b132-4e47-919e-addb2270dd3b" returned: 0 in 0.271s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.dfa417c7-b132-4e47-919e-addb2270dd3b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:08 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-d50a79e9-e052-47b0-92b7-996014825045 tempest-VolumesTransfersV355Test-933351461 None] Acquiring lock "cinder-45b223ea-0e2a-4a7d-ac5e-020d6d75987f-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:53:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35.dfa417c7-b132-4e47-919e-addb2270dd3b" returned: 0 in 0.291s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:08 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-d50a79e9-e052-47b0-92b7-996014825045 tempest-VolumesTransfersV355Test-933351461 None] Lock "cinder-45b223ea-0e2a-4a7d-ac5e-020d6d75987f-delete_volume" acquired by "delete_volume" :: waited 0.131s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:53:08 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Lock "cinder-quobyte-dfa417c7-b132-4e47-919e-addb2270dd3b" released by "_delete_snapshot" :: held 1.708s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:53:08 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Lock "cinder-quobyte-1138e786-8293-4d73-be7e-1049822dde35" released by "delete_snapshot" :: held 1.754s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:53:08 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-d50a79e9-e052-47b0-92b7-996014825045 tempest-VolumesTransfersV355Test-933351461 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:53:08 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-d50a79e9-e052-47b0-92b7-996014825045 tempest-VolumesTransfersV355Test-933351461 None] Acquiring lock "cinder-quobyte-45b223ea-0e2a-4a7d-ac5e-020d6d75987f" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:53:08 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-d50a79e9-e052-47b0-92b7-996014825045 tempest-VolumesTransfersV355Test-933351461 None] Lock "cinder-quobyte-45b223ea-0e2a-4a7d-ac5e-020d6d75987f" acquired by "delete_volume" :: waited 0.025s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:53:08 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc88bc30-11e7-4f79-9bb2-0778a66b3bd1]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:53:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d50a79e9-e052-47b0-92b7-996014825045 tempest-VolumesTransfersV355Test-933351461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-45b223ea-0e2a-4a7d-ac5e-020d6d75987f {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:09 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Created reservations ['9cbd0fac-d175-4c45-8db4-bcdf97dc936b', '0dbe011e-da89-4c97-bf3b-bfa74f8df033', '135954c9-af4c-4ffc-8560-98e70184bac7', 'cbf4a13b-6b75-447a-8c04-2d40f9b4ea32'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:53:09 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=68,cinder:UPDATE=91,cinder:DELETE=13,cinder:INSERT=22 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:53:09 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Delete snapshot completed successfully.
Sep 18 11:53:09 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Lock "cinder-dfa417c7-b132-4e47-919e-addb2270dd3b-delete_snapshot" released by "delete_snapshot" :: held 2.606s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:53:09 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Snapshots deleted, issuing volume delete {{(pid=83176) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 18 11:53:09 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Acquiring lock "cinder-quobyte-1138e786-8293-4d73-be7e-1049822dde35" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:53:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d50a79e9-e052-47b0-92b7-996014825045 tempest-VolumesTransfersV355Test-933351461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-45b223ea-0e2a-4a7d-ac5e-020d6d75987f" returned: 0 in 0.608s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d50a79e9-e052-47b0-92b7-996014825045 tempest-VolumesTransfersV355Test-933351461 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-45b223ea-0e2a-4a7d-ac5e-020d6d75987f {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:09 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Lock "cinder-quobyte-1138e786-8293-4d73-be7e-1049822dde35" acquired by "delete_volume" :: waited 0.167s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:53:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d50a79e9-e052-47b0-92b7-996014825045 tempest-VolumesTransfersV355Test-933351461 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-45b223ea-0e2a-4a7d-ac5e-020d6d75987f" returned: 0 in 0.228s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:09 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b6fb32-a7b1-44d9-9149-ee89383b748e]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:53:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:09 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-d50a79e9-e052-47b0-92b7-996014825045 tempest-VolumesTransfersV355Test-933351461 None] Lock "cinder-quobyte-45b223ea-0e2a-4a7d-ac5e-020d6d75987f" released by "delete_volume" :: held 1.062s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:53:10 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:UPDATE=102,cinder:SELECT=66,cinder:INSERT=18,cinder:DELETE=7 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:53:10 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-d50a79e9-e052-47b0-92b7-996014825045 tempest-VolumesTransfersV355Test-933351461 None] Created reservations ['08397064-2516-4e77-b629-937303888d77', 'b9f15190-d77e-4980-83b7-a7f8d74881f7', '09fcb2cc-b6a8-4e91-a84a-0795465d3396', '8f4f859b-0700-470d-8ccd-5c04f4357d97'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:53:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35" returned: 0 in 0.583s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d50a79e9-e052-47b0-92b7-996014825045 tempest-VolumesTransfersV355Test-933351461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:53:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d50a79e9-e052-47b0-92b7-996014825045 tempest-VolumesTransfersV355Test-933351461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.021s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:53:10 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-d50a79e9-e052-47b0-92b7-996014825045 tempest-VolumesTransfersV355Test-933351461 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:53:10 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-d50a79e9-e052-47b0-92b7-996014825045 tempest-VolumesTransfersV355Test-933351461 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:53:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d50a79e9-e052-47b0-92b7-996014825045 tempest-VolumesTransfersV355Test-933351461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:53:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d50a79e9-e052-47b0-92b7-996014825045 tempest-VolumesTransfersV355Test-933351461 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1138e786-8293-4d73-be7e-1049822dde35" returned: 0 in 0.475s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:10 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Lock "cinder-quobyte-1138e786-8293-4d73-be7e-1049822dde35" released by "delete_volume" :: held 1.293s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:53:11 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d50a79e9-e052-47b0-92b7-996014825045 tempest-VolumesTransfersV355Test-933351461 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.397s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:11 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-d50a79e9-e052-47b0-92b7-996014825045 tempest-VolumesTransfersV355Test-933351461 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:53:11 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-d50a79e9-e052-47b0-92b7-996014825045 tempest-VolumesTransfersV355Test-933351461 None] Deleted volume successfully.
Sep 18 11:53:11 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-d50a79e9-e052-47b0-92b7-996014825045 tempest-VolumesTransfersV355Test-933351461 None] Lock "cinder-45b223ea-0e2a-4a7d-ac5e-020d6d75987f-delete_volume" released by "delete_volume" :: held 2.738s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:53:11 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Created reservations ['702e1fe8-efa5-46f5-a543-5e02aa69e542', '8d15a8c2-eb07-46af-aa63-e415785157f6', '20ddb0c5-e6a3-4a56-be95-347110e2fe2a', 'dc52bade-9cb5-46d5-84fd-fbb1bb80a9bb'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:53:11 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:53:11 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:53:11 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:53:11 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:53:11 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:53:11 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:11 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.092s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:11 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:53:11 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Deleted volume successfully.
Sep 18 11:53:11 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-c859d42d-fe1a-4bda-a71b-fdc7125ea144 tempest-VolumesDeleteCascade-63270987 None] Lock "cinder-1138e786-8293-4d73-be7e-1049822dde35-delete_volume" released by "delete_volume" :: held 10.528s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:53:13 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-66b79e13-9dca-420d-9e19-5506da8bd19a tempest-VolumesDeleteCascade-63270987 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:53:13 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-66b79e13-9dca-420d-9e19-5506da8bd19a tempest-VolumesDeleteCascade-63270987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:53:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-66b79e13-9dca-420d-9e19-5506da8bd19a tempest-VolumesDeleteCascade-63270987 None] Flow 'volume_create_manager' (cd8f26c1-4fa1-474f-a352-504231b520b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:53:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-66b79e13-9dca-420d-9e19-5506da8bd19a tempest-VolumesDeleteCascade-63270987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (addc7bdd-28d9-480f-bcef-f636167cc368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-66b79e13-9dca-420d-9e19-5506da8bd19a tempest-VolumesDeleteCascade-63270987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (addc7bdd-28d9-480f-bcef-f636167cc368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:53:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1373641663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f01e9a7-28f0-4465-af38-84e8e17f79d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65ab19eea2ec48029824cb3936c31e33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:53:13Z,use_quota=True,user_id='74482b8b38054e10b2535732a998928f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-66b79e13-9dca-420d-9e19-5506da8bd19a tempest-VolumesDeleteCascade-63270987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a361e27e-9342-4597-accb-7b0f30a7d421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-66b79e13-9dca-420d-9e19-5506da8bd19a tempest-VolumesDeleteCascade-63270987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a361e27e-9342-4597-accb-7b0f30a7d421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-66b79e13-9dca-420d-9e19-5506da8bd19a tempest-VolumesDeleteCascade-63270987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0900152e-1d18-41d5-ac28-e162c7d5d840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-66b79e13-9dca-420d-9e19-5506da8bd19a tempest-VolumesDeleteCascade-63270987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0900152e-1d18-41d5-ac28-e162c7d5d840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f01e9a7-28f0-4465-af38-84e8e17f79d5', 'volume_name': 'volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-66b79e13-9dca-420d-9e19-5506da8bd19a tempest-VolumesDeleteCascade-63270987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58e01843-fe01-46d1-8d63-7959b03252c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-66b79e13-9dca-420d-9e19-5506da8bd19a tempest-VolumesDeleteCascade-63270987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58e01843-fe01-46d1-8d63-7959b03252c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-66b79e13-9dca-420d-9e19-5506da8bd19a tempest-VolumesDeleteCascade-63270987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef41509a-5901-45d1-b903-16019187ff4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:13 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-66b79e13-9dca-420d-9e19-5506da8bd19a tempest-VolumesDeleteCascade-63270987 None] Volume 2f01e9a7-28f0-4465-af38-84e8e17f79d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5', 'volume_size': 1}
Sep 18 11:53:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-66b79e13-9dca-420d-9e19-5506da8bd19a tempest-VolumesDeleteCascade-63270987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:53:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-66b79e13-9dca-420d-9e19-5506da8bd19a tempest-VolumesDeleteCascade-63270987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:53:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-66b79e13-9dca-420d-9e19-5506da8bd19a tempest-VolumesDeleteCascade-63270987 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:53:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1373641663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f01e9a7-28f0-4465-af38-84e8e17f79d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65ab19eea2ec48029824cb3936c31e33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:53:13Z,use_quota=True,user_id='74482b8b38054e10b2535732a998928f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:53:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-66b79e13-9dca-420d-9e19-5506da8bd19a tempest-VolumesDeleteCascade-63270987 None] Creating volume 2f01e9a7-28f0-4465-af38-84e8e17f79d5 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:53:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-66b79e13-9dca-420d-9e19-5506da8bd19a tempest-VolumesDeleteCascade-63270987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:53:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-66b79e13-9dca-420d-9e19-5506da8bd19a tempest-VolumesDeleteCascade-63270987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:53:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-66b79e13-9dca-420d-9e19-5506da8bd19a tempest-VolumesDeleteCascade-63270987 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:53:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-66b79e13-9dca-420d-9e19-5506da8bd19a tempest-VolumesDeleteCascade-63270987 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:53:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-66b79e13-9dca-420d-9e19-5506da8bd19a tempest-VolumesDeleteCascade-63270987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:53:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-66b79e13-9dca-420d-9e19-5506da8bd19a tempest-VolumesDeleteCascade-63270987 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:53:13 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-66b79e13-9dca-420d-9e19-5506da8bd19a tempest-VolumesDeleteCascade-63270987 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:53:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-66b79e13-9dca-420d-9e19-5506da8bd19a tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:13 devstack quobyte-client[83193]: System call of process 94881 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:53:13 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=102, name=volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:53:13 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 11:53:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:53:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:53:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:53:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:53:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:53:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-66b79e13-9dca-420d-9e19-5506da8bd19a tempest-VolumesDeleteCascade-63270987 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5 1073741824" returned: 0 in 0.522s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-66b79e13-9dca-420d-9e19-5506da8bd19a tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.224s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:14 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:53:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-66b79e13-9dca-420d-9e19-5506da8bd19a tempest-VolumesDeleteCascade-63270987 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5" returned: 0 in 0.208s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-66b79e13-9dca-420d-9e19-5506da8bd19a tempest-VolumesDeleteCascade-63270987 None] <== create_volume: return (779ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:53:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-66b79e13-9dca-420d-9e19-5506da8bd19a tempest-VolumesDeleteCascade-63270987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:53:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-66b79e13-9dca-420d-9e19-5506da8bd19a tempest-VolumesDeleteCascade-63270987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef41509a-5901-45d1-b903-16019187ff4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-66b79e13-9dca-420d-9e19-5506da8bd19a tempest-VolumesDeleteCascade-63270987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c0c6c98-5277-4fb7-8708-5dd567aab304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:14 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-66b79e13-9dca-420d-9e19-5506da8bd19a tempest-VolumesDeleteCascade-63270987 None] Volume volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5 (2f01e9a7-28f0-4465-af38-84e8e17f79d5): created successfully
Sep 18 11:53:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-66b79e13-9dca-420d-9e19-5506da8bd19a tempest-VolumesDeleteCascade-63270987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c0c6c98-5277-4fb7-8708-5dd567aab304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-66b79e13-9dca-420d-9e19-5506da8bd19a tempest-VolumesDeleteCascade-63270987 None] Flow 'volume_create_manager' (cd8f26c1-4fa1-474f-a352-504231b520b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:53:14 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-66b79e13-9dca-420d-9e19-5506da8bd19a tempest-VolumesDeleteCascade-63270987 None] Created volume successfully.
Sep 18 11:53:15 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-0f16208a-1798-4dda-b902-6d8452f3f477 tempest-VolumesDeleteCascade-63270987 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:53:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0f16208a-1798-4dda-b902-6d8452f3f477 tempest-VolumesDeleteCascade-63270987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:53:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0f16208a-1798-4dda-b902-6d8452f3f477 tempest-VolumesDeleteCascade-63270987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:53:15 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-0f16208a-1798-4dda-b902-6d8452f3f477 tempest-VolumesDeleteCascade-63270987 None] Creating offline snapshot 36997c8a-3ba2-4b15-95a5-d3e5dd9d2d5f of volume 2f01e9a7-28f0-4465-af38-84e8e17f79d5 {{(pid=83176) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 11:53:15 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b586e4-2de7-4fd6-be07-a77a8df59a74]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:53:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0f16208a-1798-4dda-b902-6d8452f3f477 tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0f16208a-1798-4dda-b902-6d8452f3f477 tempest-VolumesDeleteCascade-63270987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5" returned: 0 in 0.493s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0f16208a-1798-4dda-b902-6d8452f3f477 tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5.36997c8a-3ba2-4b15-95a5-d3e5dd9d2d5f 1G {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:16 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=103, name=volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5.36997c8a-3ba2-4b15-95a5-d3e5dd9d2d5f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:53:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0f16208a-1798-4dda-b902-6d8452f3f477 tempest-VolumesDeleteCascade-63270987 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5.36997c8a-3ba2-4b15-95a5-d3e5dd9d2d5f 1G" returned: 0 in 0.297s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0f16208a-1798-4dda-b902-6d8452f3f477 tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): qemu-img rebase -u -b volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5 -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5.36997c8a-3ba2-4b15-95a5-d3e5dd9d2d5f {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:16 devstack quobyte-client[83193]: System call of process 94893 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:53:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0f16208a-1798-4dda-b902-6d8452f3f477 tempest-VolumesDeleteCascade-63270987 None] CMD "qemu-img rebase -u -b volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5 -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5.36997c8a-3ba2-4b15-95a5-d3e5dd9d2d5f" returned: 0 in 0.203s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:16 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-0f16208a-1798-4dda-b902-6d8452f3f477 tempest-VolumesDeleteCascade-63270987 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5.36997c8a-3ba2-4b15-95a5-d3e5dd9d2d5f is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 11:53:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0f16208a-1798-4dda-b902-6d8452f3f477 tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5.36997c8a-3ba2-4b15-95a5-d3e5dd9d2d5f {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0f16208a-1798-4dda-b902-6d8452f3f477 tempest-VolumesDeleteCascade-63270987 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5.36997c8a-3ba2-4b15-95a5-d3e5dd9d2d5f" returned: 0 in 0.088s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:17 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-0f16208a-1798-4dda-b902-6d8452f3f477 tempest-VolumesDeleteCascade-63270987 None] Setting permissions: /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5 -> 1000:1000 {{(pid=83176) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 11:53:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0f16208a-1798-4dda-b902-6d8452f3f477 tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5.36997c8a-3ba2-4b15-95a5-d3e5dd9d2d5f {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0f16208a-1798-4dda-b902-6d8452f3f477 tempest-VolumesDeleteCascade-63270987 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5.36997c8a-3ba2-4b15-95a5-d3e5dd9d2d5f" returned: 0 in 0.101s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0f16208a-1798-4dda-b902-6d8452f3f477 tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5.info {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0f16208a-1798-4dda-b902-6d8452f3f477 tempest-VolumesDeleteCascade-63270987 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5.info" returned: 0 in 0.112s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:17 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-0f16208a-1798-4dda-b902-6d8452f3f477 tempest-VolumesDeleteCascade-63270987 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5.info is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 11:53:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0f16208a-1798-4dda-b902-6d8452f3f477 tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5.info {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0f16208a-1798-4dda-b902-6d8452f3f477 tempest-VolumesDeleteCascade-63270987 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5.info" returned: 0 in 0.096s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0f16208a-1798-4dda-b902-6d8452f3f477 tempest-VolumesDeleteCascade-63270987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.770s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:53:17 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-0f16208a-1798-4dda-b902-6d8452f3f477 tempest-VolumesDeleteCascade-63270987 None] Create snapshot completed successfully
Sep 18 11:53:19 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-2c06169c-3c60-427d-92da-b8bbc552f1a3 tempest-VolumesTransfersV357Test-1945681605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:53:19 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c06169c-3c60-427d-92da-b8bbc552f1a3 tempest-VolumesTransfersV357Test-1945681605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:53:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2c06169c-3c60-427d-92da-b8bbc552f1a3 tempest-VolumesTransfersV357Test-1945681605 None] Flow 'volume_create_manager' (cbb2c496-450e-4b77-b6fe-f3c2183b5071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:53:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2c06169c-3c60-427d-92da-b8bbc552f1a3 tempest-VolumesTransfersV357Test-1945681605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93a295a9-b9cf-487d-bf81-87d736bafc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2c06169c-3c60-427d-92da-b8bbc552f1a3 tempest-VolumesTransfersV357Test-1945681605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93a295a9-b9cf-487d-bf81-87d736bafc88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1893270756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8cd302e-a8ea-40b3-b717-3902227fd3ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b125d2b76a464bb3a54a93f7fa7cbe07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:53:19Z,use_quota=True,user_id='5211c9f45820460c98ae7aa5bad663be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2c06169c-3c60-427d-92da-b8bbc552f1a3 tempest-VolumesTransfersV357Test-1945681605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f95db1-e6a1-42b3-8c11-6dbdd2a4f8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2c06169c-3c60-427d-92da-b8bbc552f1a3 tempest-VolumesTransfersV357Test-1945681605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f95db1-e6a1-42b3-8c11-6dbdd2a4f8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2c06169c-3c60-427d-92da-b8bbc552f1a3 tempest-VolumesTransfersV357Test-1945681605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82378bc9-758d-4b07-a382-4d02ba5ac30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2c06169c-3c60-427d-92da-b8bbc552f1a3 tempest-VolumesTransfersV357Test-1945681605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82378bc9-758d-4b07-a382-4d02ba5ac30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8cd302e-a8ea-40b3-b717-3902227fd3ba', 'volume_name': 'volume-d8cd302e-a8ea-40b3-b717-3902227fd3ba', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2c06169c-3c60-427d-92da-b8bbc552f1a3 tempest-VolumesTransfersV357Test-1945681605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51cf2574-a574-4e45-9429-e4288043a6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2c06169c-3c60-427d-92da-b8bbc552f1a3 tempest-VolumesTransfersV357Test-1945681605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51cf2574-a574-4e45-9429-e4288043a6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2c06169c-3c60-427d-92da-b8bbc552f1a3 tempest-VolumesTransfersV357Test-1945681605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dad1db4-78f2-46dc-833d-d5a542775fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:19 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-2c06169c-3c60-427d-92da-b8bbc552f1a3 tempest-VolumesTransfersV357Test-1945681605 None] Volume d8cd302e-a8ea-40b3-b717-3902227fd3ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8cd302e-a8ea-40b3-b717-3902227fd3ba', 'volume_size': 1}
Sep 18 11:53:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-2c06169c-3c60-427d-92da-b8bbc552f1a3 tempest-VolumesTransfersV357Test-1945681605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:53:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-2c06169c-3c60-427d-92da-b8bbc552f1a3 tempest-VolumesTransfersV357Test-1945681605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:53:19 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-2c06169c-3c60-427d-92da-b8bbc552f1a3 tempest-VolumesTransfersV357Test-1945681605 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1893270756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8cd302e-a8ea-40b3-b717-3902227fd3ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b125d2b76a464bb3a54a93f7fa7cbe07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:53:19Z,use_quota=True,user_id='5211c9f45820460c98ae7aa5bad663be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:53:19 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-2c06169c-3c60-427d-92da-b8bbc552f1a3 tempest-VolumesTransfersV357Test-1945681605 None] Creating volume d8cd302e-a8ea-40b3-b717-3902227fd3ba {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:53:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-2c06169c-3c60-427d-92da-b8bbc552f1a3 tempest-VolumesTransfersV357Test-1945681605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:53:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-2c06169c-3c60-427d-92da-b8bbc552f1a3 tempest-VolumesTransfersV357Test-1945681605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:53:19 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-2c06169c-3c60-427d-92da-b8bbc552f1a3 tempest-VolumesTransfersV357Test-1945681605 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:53:19 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-2c06169c-3c60-427d-92da-b8bbc552f1a3 tempest-VolumesTransfersV357Test-1945681605 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:53:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-2c06169c-3c60-427d-92da-b8bbc552f1a3 tempest-VolumesTransfersV357Test-1945681605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:53:19 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-2c06169c-3c60-427d-92da-b8bbc552f1a3 tempest-VolumesTransfersV357Test-1945681605 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:53:19 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-2c06169c-3c60-427d-92da-b8bbc552f1a3 tempest-VolumesTransfersV357Test-1945681605 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:53:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2c06169c-3c60-427d-92da-b8bbc552f1a3 tempest-VolumesTransfersV357Test-1945681605 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d8cd302e-a8ea-40b3-b717-3902227fd3ba 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:19 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=105, name=volume-d8cd302e-a8ea-40b3-b717-3902227fd3ba, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:53:19 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:53:19 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:53:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2c06169c-3c60-427d-92da-b8bbc552f1a3 tempest-VolumesTransfersV357Test-1945681605 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d8cd302e-a8ea-40b3-b717-3902227fd3ba 1073741824" returned: 0 in 0.524s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2c06169c-3c60-427d-92da-b8bbc552f1a3 tempest-VolumesTransfersV357Test-1945681605 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d8cd302e-a8ea-40b3-b717-3902227fd3ba {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Flow 'volume_create_manager' (4a0c89cd-6520-44ff-984a-e7296834bf67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:53:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c22b14c7-57e5-45c4-a4d2-28ec28a6584f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c22b14c7-57e5-45c4-a4d2-28ec28a6584f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1366172935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1373cc8c-ccb7-4393-9fe4-823486fbeb21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65ab19eea2ec48029824cb3936c31e33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=36997c8a-3ba2-4b15-95a5-d3e5dd9d2d5f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:53:19Z,use_quota=True,user_id='74482b8b38054e10b2535732a998928f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e848ae0-c8a6-40c8-bc21-cbc47e215be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e848ae0-c8a6-40c8-bc21-cbc47e215be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (968e86af-5d24-4e25-9759-72478a1e5f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (968e86af-5d24-4e25-9759-72478a1e5f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1373cc8c-ccb7-4393-9fe4-823486fbeb21', 'volume_name': 'volume-1373cc8c-ccb7-4393-9fe4-823486fbeb21', 'volume_size': 1, 'snapshot_id': '36997c8a-3ba2-4b15-95a5-d3e5dd9d2d5f'}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb6b7702-0f20-4724-8a55-ed97cc05ea56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb6b7702-0f20-4724-8a55-ed97cc05ea56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c931e4e8-ac61-4e61-b1c2-e4b6d1f58075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:20 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Volume 1373cc8c-ccb7-4393-9fe4-823486fbeb21: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1373cc8c-ccb7-4393-9fe4-823486fbeb21', 'volume_size': 1, 'snapshot_id': '36997c8a-3ba2-4b15-95a5-d3e5dd9d2d5f'}
Sep 18 11:53:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2c06169c-3c60-427d-92da-b8bbc552f1a3 tempest-VolumesTransfersV357Test-1945681605 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d8cd302e-a8ea-40b3-b717-3902227fd3ba" returned: 0 in 0.489s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:20 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-2c06169c-3c60-427d-92da-b8bbc552f1a3 tempest-VolumesTransfersV357Test-1945681605 None] <== create_volume: return (1032ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:53:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-2c06169c-3c60-427d-92da-b8bbc552f1a3 tempest-VolumesTransfersV357Test-1945681605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:53:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:53:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:53:20 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Acquiring lock "cinder-quobyte-36997c8a-3ba2-4b15-95a5-d3e5dd9d2d5f-1373cc8c-ccb7-4393-9fe4-823486fbeb21" by "_create_volume_from_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:53:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2c06169c-3c60-427d-92da-b8bbc552f1a3 tempest-VolumesTransfersV357Test-1945681605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dad1db4-78f2-46dc-833d-d5a542775fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8cd302e-a8ea-40b3-b717-3902227fd3ba', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2c06169c-3c60-427d-92da-b8bbc552f1a3 tempest-VolumesTransfersV357Test-1945681605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b54d86f-96c7-4a2e-9723-a4fe892fa821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:20 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Lock "cinder-quobyte-36997c8a-3ba2-4b15-95a5-d3e5dd9d2d5f-1373cc8c-ccb7-4393-9fe4-823486fbeb21" acquired by "_create_volume_from_snapshot" :: waited 0.044s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:53:20 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Creating volume 1373cc8c-ccb7-4393-9fe4-823486fbeb21 from snapshot 36997c8a-3ba2-4b15-95a5-d3e5dd9d2d5f {{(pid=83176) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 18 11:53:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:53:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:53:20 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:53:20 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:53:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:53:20 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:53:20 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Acquiring lock "cinder-quobyte-1373cc8c-ccb7-4393-9fe4-823486fbeb21" by "_copy_volume_from_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:53:20 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-2c06169c-3c60-427d-92da-b8bbc552f1a3 tempest-VolumesTransfersV357Test-1945681605 None] Volume volume-d8cd302e-a8ea-40b3-b717-3902227fd3ba (d8cd302e-a8ea-40b3-b717-3902227fd3ba): created successfully
Sep 18 11:53:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2c06169c-3c60-427d-92da-b8bbc552f1a3 tempest-VolumesTransfersV357Test-1945681605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b54d86f-96c7-4a2e-9723-a4fe892fa821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2c06169c-3c60-427d-92da-b8bbc552f1a3 tempest-VolumesTransfersV357Test-1945681605 None] Flow 'volume_create_manager' (cbb2c496-450e-4b77-b6fe-f3c2183b5071) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:53:20 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Lock "cinder-quobyte-1373cc8c-ccb7-4393-9fe4-823486fbeb21" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:53:20 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] snapshot: 36997c8a-3ba2-4b15-95a5-d3e5dd9d2d5f, volume: 1373cc8c-ccb7-4393-9fe4-823486fbeb21,  {{(pid=83176) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 18 11:53:20 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-2c06169c-3c60-427d-92da-b8bbc552f1a3 tempest-VolumesTransfersV357Test-1945681605 None] Created volume successfully.
Sep 18 11:53:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:53:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:53:20 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:53:20 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:53:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:53:20 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0037e9ef-9262-4663-bcbd-c9e7ab9cc72f]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:53:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5.36997c8a-3ba2-4b15-95a5-d3e5dd9d2d5f {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5.36997c8a-3ba2-4b15-95a5-d3e5dd9d2d5f" returned: 0 in 0.476s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:21 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 11:53:21 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] will copy from snapshot at /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5 {{(pid=83176) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 18 11:53:21 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Creating direct copy from snapshot {{(pid=83176) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 18 11:53:21 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[461d89f3-56e8-45de-8ab5-db95ab9a38c7]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:53:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5" returned: 0 in 0.458s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:21 devstack cinder-volume[83176]: DEBUG cinder.utils [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1373cc8c-ccb7-4393-9fe4-823486fbeb21 not found in is_blk_device check {{(pid=83176) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 18 11:53:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1373cc8c-ccb7-4393-9fe4-823486fbeb21 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:21 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=106, name=volume-1373cc8c-ccb7-4393-9fe4-823486fbeb21, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:53:22 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-0b8caf4c-1212-4832-ae81-c17d41c20724 tempest-VolumesTransfersV357Test-2104852621 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:53:22 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-0b8caf4c-1212-4832-ae81-c17d41c20724 tempest-VolumesTransfersV357Test-2104852621 None] Transfer volume completed successfully.
Sep 18 11:53:24 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0a9e98bf-f674-4623-a0dc-4f6c9e0488ac tempest-VolumesTransfersV357Test-1495175030 None] Acquiring lock "cinder-d8cd302e-a8ea-40b3-b717-3902227fd3ba-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:53:24 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0a9e98bf-f674-4623-a0dc-4f6c9e0488ac tempest-VolumesTransfersV357Test-1495175030 None] Lock "cinder-d8cd302e-a8ea-40b3-b717-3902227fd3ba-delete_volume" acquired by "delete_volume" :: waited 0.228s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:53:25 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-0a9e98bf-f674-4623-a0dc-4f6c9e0488ac tempest-VolumesTransfersV357Test-1495175030 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:53:25 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0a9e98bf-f674-4623-a0dc-4f6c9e0488ac tempest-VolumesTransfersV357Test-1495175030 None] Acquiring lock "cinder-quobyte-d8cd302e-a8ea-40b3-b717-3902227fd3ba" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:53:25 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0a9e98bf-f674-4623-a0dc-4f6c9e0488ac tempest-VolumesTransfersV357Test-1495175030 None] Lock "cinder-quobyte-d8cd302e-a8ea-40b3-b717-3902227fd3ba" acquired by "delete_volume" :: waited 0.059s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:53:25 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[36910257-8863-41a7-b03e-a20b237d1e0d]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:53:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0a9e98bf-f674-4623-a0dc-4f6c9e0488ac tempest-VolumesTransfersV357Test-1495175030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d8cd302e-a8ea-40b3-b717-3902227fd3ba {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:26 devstack quobyte-client[83193]: System call of process 94922 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:53:26 devstack quobyte-client[83193]: System call of process 94922 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:53:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0a9e98bf-f674-4623-a0dc-4f6c9e0488ac tempest-VolumesTransfersV357Test-1495175030 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d8cd302e-a8ea-40b3-b717-3902227fd3ba" returned: 0 in 1.282s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0a9e98bf-f674-4623-a0dc-4f6c9e0488ac tempest-VolumesTransfersV357Test-1495175030 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d8cd302e-a8ea-40b3-b717-3902227fd3ba {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0a9e98bf-f674-4623-a0dc-4f6c9e0488ac tempest-VolumesTransfersV357Test-1495175030 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d8cd302e-a8ea-40b3-b717-3902227fd3ba" returned: 0 in 0.393s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:27 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0a9e98bf-f674-4623-a0dc-4f6c9e0488ac tempest-VolumesTransfersV357Test-1495175030 None] Lock "cinder-quobyte-d8cd302e-a8ea-40b3-b717-3902227fd3ba" released by "delete_volume" :: held 2.193s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:53:28 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-0a9e98bf-f674-4623-a0dc-4f6c9e0488ac tempest-VolumesTransfersV357Test-1495175030 None] Created reservations ['19844b0a-cda8-4de8-91c8-4fa5f565b0d5', 'de8255c0-7a0e-4d47-946f-df34fd3e1fc1', '12c023ad-53fe-452c-bee5-1d739ba7c9d8', '38074540-ef84-40e1-9c81-559b35a5d70c'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:53:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1373cc8c-ccb7-4393-9fe4-823486fbeb21" returned: 0 in 6.624s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:28 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f31aa0-8866-4a32-a3ef-991aacf6df96]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:53:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0a9e98bf-f674-4623-a0dc-4f6c9e0488ac tempest-VolumesTransfersV357Test-1495175030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:53:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0a9e98bf-f674-4623-a0dc-4f6c9e0488ac tempest-VolumesTransfersV357Test-1495175030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.033s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:53:28 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-0a9e98bf-f674-4623-a0dc-4f6c9e0488ac tempest-VolumesTransfersV357Test-1495175030 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:53:28 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-0a9e98bf-f674-4623-a0dc-4f6c9e0488ac tempest-VolumesTransfersV357Test-1495175030 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:53:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0a9e98bf-f674-4623-a0dc-4f6c9e0488ac tempest-VolumesTransfersV357Test-1495175030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:53:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0a9e98bf-f674-4623-a0dc-4f6c9e0488ac tempest-VolumesTransfersV357Test-1495175030 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0a9e98bf-f674-4623-a0dc-4f6c9e0488ac tempest-VolumesTransfersV357Test-1495175030 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.129s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:28 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-0a9e98bf-f674-4623-a0dc-4f6c9e0488ac tempest-VolumesTransfersV357Test-1495175030 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:53:28 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-0a9e98bf-f674-4623-a0dc-4f6c9e0488ac tempest-VolumesTransfersV357Test-1495175030 None] Deleted volume successfully.
Sep 18 11:53:29 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0a9e98bf-f674-4623-a0dc-4f6c9e0488ac tempest-VolumesTransfersV357Test-1495175030 None] Lock "cinder-d8cd302e-a8ea-40b3-b717-3902227fd3ba-delete_volume" released by "delete_volume" :: held 4.403s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:53:29 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-21cd62cf-837e-40a2-885d-3c5d4f2778ad tempest-VolumesTransfersV357Test-1945681605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:53:29 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-21cd62cf-837e-40a2-885d-3c5d4f2778ad tempest-VolumesTransfersV357Test-1945681605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:53:29 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-21cd62cf-837e-40a2-885d-3c5d4f2778ad tempest-VolumesTransfersV357Test-1945681605 None] Flow 'volume_create_manager' (6f05305b-c89f-4468-82db-ee6f5bc0ae6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:53:29 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-21cd62cf-837e-40a2-885d-3c5d4f2778ad tempest-VolumesTransfersV357Test-1945681605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96bd47eb-ab99-482c-89ce-e13d72fda48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:29 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-21cd62cf-837e-40a2-885d-3c5d4f2778ad tempest-VolumesTransfersV357Test-1945681605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96bd47eb-ab99-482c-89ce-e13d72fda48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:53:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-60540221',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73a09597-3ac3-41ef-a9de-ad7204954a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b125d2b76a464bb3a54a93f7fa7cbe07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:53:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:53:29Z,use_quota=True,user_id='5211c9f45820460c98ae7aa5bad663be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:29 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-21cd62cf-837e-40a2-885d-3c5d4f2778ad tempest-VolumesTransfersV357Test-1945681605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0a12200-10af-41e0-9dd3-4886f8e0983e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:29 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-21cd62cf-837e-40a2-885d-3c5d4f2778ad tempest-VolumesTransfersV357Test-1945681605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0a12200-10af-41e0-9dd3-4886f8e0983e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:29 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-21cd62cf-837e-40a2-885d-3c5d4f2778ad tempest-VolumesTransfersV357Test-1945681605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3818e9c6-d3e2-481b-9b89-992dc1c1b2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:29 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-21cd62cf-837e-40a2-885d-3c5d4f2778ad tempest-VolumesTransfersV357Test-1945681605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3818e9c6-d3e2-481b-9b89-992dc1c1b2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73a09597-3ac3-41ef-a9de-ad7204954a62', 'volume_name': 'volume-73a09597-3ac3-41ef-a9de-ad7204954a62', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:29 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-21cd62cf-837e-40a2-885d-3c5d4f2778ad tempest-VolumesTransfersV357Test-1945681605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d57da896-95e4-49cb-8aaa-9ed7628b9bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:29 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-21cd62cf-837e-40a2-885d-3c5d4f2778ad tempest-VolumesTransfersV357Test-1945681605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d57da896-95e4-49cb-8aaa-9ed7628b9bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:29 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-21cd62cf-837e-40a2-885d-3c5d4f2778ad tempest-VolumesTransfersV357Test-1945681605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9830776b-4ee3-4357-8c63-47f73daa3401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:29 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-21cd62cf-837e-40a2-885d-3c5d4f2778ad tempest-VolumesTransfersV357Test-1945681605 None] Volume 73a09597-3ac3-41ef-a9de-ad7204954a62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73a09597-3ac3-41ef-a9de-ad7204954a62', 'volume_size': 1}
Sep 18 11:53:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-21cd62cf-837e-40a2-885d-3c5d4f2778ad tempest-VolumesTransfersV357Test-1945681605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:53:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5" returned: 0 in 1.103s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:29 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Image conversion details: src /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5, size 1024.00 MB, duration 6.63 sec, destination /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1373cc8c-ccb7-4393-9fe4-823486fbeb21 {{(pid=83176) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 11:53:29 devstack cinder-volume[83176]: INFO cinder.image.image_utils [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Converted 1024.00 MB image at 154.51 MB/s
Sep 18 11:53:29 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1373cc8c-ccb7-4393-9fe4-823486fbeb21 is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 11:53:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1373cc8c-ccb7-4393-9fe4-823486fbeb21 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1373cc8c-ccb7-4393-9fe4-823486fbeb21" returned: 0 in 0.110s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:29 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Lock "cinder-quobyte-1373cc8c-ccb7-4393-9fe4-823486fbeb21" released by "_copy_volume_from_snapshot" :: held 9.103s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:53:29 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Lock "cinder-quobyte-36997c8a-3ba2-4b15-95a5-d3e5dd9d2d5f-1373cc8c-ccb7-4393-9fe4-823486fbeb21" released by "_create_volume_from_snapshot" :: held 9.159s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:53:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.212s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:53:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-21cd62cf-837e-40a2-885d-3c5d4f2778ad tempest-VolumesTransfersV357Test-1945681605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.317s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:53:29 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-21cd62cf-837e-40a2-885d-3c5d4f2778ad tempest-VolumesTransfersV357Test-1945681605 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:53:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-60540221',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73a09597-3ac3-41ef-a9de-ad7204954a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b125d2b76a464bb3a54a93f7fa7cbe07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:53:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:53:29Z,use_quota=True,user_id='5211c9f45820460c98ae7aa5bad663be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:53:29 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-21cd62cf-837e-40a2-885d-3c5d4f2778ad tempest-VolumesTransfersV357Test-1945681605 None] Creating volume 73a09597-3ac3-41ef-a9de-ad7204954a62 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:53:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-21cd62cf-837e-40a2-885d-3c5d4f2778ad tempest-VolumesTransfersV357Test-1945681605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:53:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-21cd62cf-837e-40a2-885d-3c5d4f2778ad tempest-VolumesTransfersV357Test-1945681605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:53:29 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-21cd62cf-837e-40a2-885d-3c5d4f2778ad tempest-VolumesTransfersV357Test-1945681605 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:53:29 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-21cd62cf-837e-40a2-885d-3c5d4f2778ad tempest-VolumesTransfersV357Test-1945681605 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:53:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-21cd62cf-837e-40a2-885d-3c5d4f2778ad tempest-VolumesTransfersV357Test-1945681605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:53:29 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-21cd62cf-837e-40a2-885d-3c5d4f2778ad tempest-VolumesTransfersV357Test-1945681605 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:53:29 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-21cd62cf-837e-40a2-885d-3c5d4f2778ad tempest-VolumesTransfersV357Test-1945681605 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:53:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-21cd62cf-837e-40a2-885d-3c5d4f2778ad tempest-VolumesTransfersV357Test-1945681605 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-73a09597-3ac3-41ef-a9de-ad7204954a62 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:30 devstack quobyte-client[83193]: System call of process 94931 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:53:30 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=107, name=volume-73a09597-3ac3-41ef-a9de-ad7204954a62, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:53:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-21cd62cf-837e-40a2-885d-3c5d4f2778ad tempest-VolumesTransfersV357Test-1945681605 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-73a09597-3ac3-41ef-a9de-ad7204954a62 1073741824" returned: 0 in 0.409s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-21cd62cf-837e-40a2-885d-3c5d4f2778ad tempest-VolumesTransfersV357Test-1945681605 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-73a09597-3ac3-41ef-a9de-ad7204954a62 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:30 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c931e4e8-ac61-4e61-b1c2-e4b6d1f58075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1373cc8c-ccb7-4393-9fe4-823486fbeb21', 'volume_size': 1, 'snapshot_id': '36997c8a-3ba2-4b15-95a5-d3e5dd9d2d5f'}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:30 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63297fa6-66d3-4297-964f-ce48b831069c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-21cd62cf-837e-40a2-885d-3c5d4f2778ad tempest-VolumesTransfersV357Test-1945681605 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-73a09597-3ac3-41ef-a9de-ad7204954a62" returned: 0 in 0.306s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:30 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-21cd62cf-837e-40a2-885d-3c5d4f2778ad tempest-VolumesTransfersV357Test-1945681605 None] <== create_volume: return (758ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:53:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-21cd62cf-837e-40a2-885d-3c5d4f2778ad tempest-VolumesTransfersV357Test-1945681605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:53:30 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Volume volume-1373cc8c-ccb7-4393-9fe4-823486fbeb21 (1373cc8c-ccb7-4393-9fe4-823486fbeb21): created successfully
Sep 18 11:53:30 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63297fa6-66d3-4297-964f-ce48b831069c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:30 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Flow 'volume_create_manager' (4a0c89cd-6520-44ff-984a-e7296834bf67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:53:30 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-21cd62cf-837e-40a2-885d-3c5d4f2778ad tempest-VolumesTransfersV357Test-1945681605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9830776b-4ee3-4357-8c63-47f73daa3401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73a09597-3ac3-41ef-a9de-ad7204954a62', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:30 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-21cd62cf-837e-40a2-885d-3c5d4f2778ad tempest-VolumesTransfersV357Test-1945681605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (257354f9-4798-441b-b9f4-312bc540db5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:30 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-21cd62cf-837e-40a2-885d-3c5d4f2778ad tempest-VolumesTransfersV357Test-1945681605 None] Volume volume-73a09597-3ac3-41ef-a9de-ad7204954a62 (73a09597-3ac3-41ef-a9de-ad7204954a62): created successfully
Sep 18 11:53:30 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-21cd62cf-837e-40a2-885d-3c5d4f2778ad tempest-VolumesTransfersV357Test-1945681605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (257354f9-4798-441b-b9f4-312bc540db5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:30 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-21cd62cf-837e-40a2-885d-3c5d4f2778ad tempest-VolumesTransfersV357Test-1945681605 None] Flow 'volume_create_manager' (6f05305b-c89f-4468-82db-ee6f5bc0ae6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:53:30 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-1a42e2fd-3697-48e3-a536-ebd5712468c2 tempest-VolumesDeleteCascade-63270987 None] Created volume successfully.
Sep 18 11:53:30 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-21cd62cf-837e-40a2-885d-3c5d4f2778ad tempest-VolumesTransfersV357Test-1945681605 None] Created volume successfully.
Sep 18 11:53:31 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] Acquiring lock "cinder-2f01e9a7-28f0-4465-af38-84e8e17f79d5-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:53:31 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] Lock "cinder-2f01e9a7-28f0-4465-af38-84e8e17f79d5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:53:31 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:53:31 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] Performing cascade delete. {{(pid=83176) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 18 11:53:31 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] Acquiring lock "cinder-36997c8a-3ba2-4b15-95a5-d3e5dd9d2d5f-delete_snapshot" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:53:31 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] Lock "cinder-36997c8a-3ba2-4b15-95a5-d3e5dd9d2d5f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:53:31 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:53:31 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] Acquiring lock "cinder-quobyte-2f01e9a7-28f0-4465-af38-84e8e17f79d5" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:53:31 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] Lock "cinder-quobyte-2f01e9a7-28f0-4465-af38-84e8e17f79d5" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:53:31 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] Acquiring lock "cinder-quobyte-36997c8a-3ba2-4b15-95a5-d3e5dd9d2d5f" by "_delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:53:31 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] Lock "cinder-quobyte-36997c8a-3ba2-4b15-95a5-d3e5dd9d2d5f" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:53:31 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] Deleting offline snapshot 36997c8a-3ba2-4b15-95a5-d3e5dd9d2d5f of volume 2f01e9a7-28f0-4465-af38-84e8e17f79d5 {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 11:53:31 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] snapshot_file for this snap is: volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5.36997c8a-3ba2-4b15-95a5-d3e5dd9d2d5f {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 11:53:31 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09e49f1-eb26-45d8-92d9-b65f442e5211]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:53:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5.36997c8a-3ba2-4b15-95a5-d3e5dd9d2d5f {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:32 devstack quobyte-client[83193]: System call of process 94935 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:53:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5.36997c8a-3ba2-4b15-95a5-d3e5dd9d2d5f" returned: 0 in 0.435s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:32 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 11:53:32 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bf1676-1e92-4804-a864-7372532fe15c]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:53:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:32 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ae53fc34-eff4-4fa8-9c0c-7e33289ea644 tempest-VolumesTransfersV357Test-1495175030 None] Acquiring lock "cinder-73a09597-3ac3-41ef-a9de-ad7204954a62-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:53:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5" returned: 0 in 0.525s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5.36997c8a-3ba2-4b15-95a5-d3e5dd9d2d5f {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:32 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ae53fc34-eff4-4fa8-9c0c-7e33289ea644 tempest-VolumesTransfersV357Test-1495175030 None] Lock "cinder-73a09597-3ac3-41ef-a9de-ad7204954a62-delete_volume" acquired by "delete_volume" :: waited 0.244s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:53:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5.36997c8a-3ba2-4b15-95a5-d3e5dd9d2d5f" returned: 0 in 0.334s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5.36997c8a-3ba2-4b15-95a5-d3e5dd9d2d5f {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5.36997c8a-3ba2-4b15-95a5-d3e5dd9d2d5f" returned: 0 in 0.281s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:33 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-ae53fc34-eff4-4fa8-9c0c-7e33289ea644 tempest-VolumesTransfersV357Test-1495175030 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:53:33 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ae53fc34-eff4-4fa8-9c0c-7e33289ea644 tempest-VolumesTransfersV357Test-1495175030 None] Acquiring lock "cinder-quobyte-73a09597-3ac3-41ef-a9de-ad7204954a62" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:53:33 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] Lock "cinder-quobyte-36997c8a-3ba2-4b15-95a5-d3e5dd9d2d5f" released by "_delete_snapshot" :: held 1.795s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:53:33 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ae53fc34-eff4-4fa8-9c0c-7e33289ea644 tempest-VolumesTransfersV357Test-1495175030 None] Lock "cinder-quobyte-73a09597-3ac3-41ef-a9de-ad7204954a62" acquired by "delete_volume" :: waited 0.072s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:53:33 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] Lock "cinder-quobyte-2f01e9a7-28f0-4465-af38-84e8e17f79d5" released by "delete_snapshot" :: held 1.827s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:53:33 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b992a4-e9d9-40eb-986b-5465ad3dfce1]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:53:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ae53fc34-eff4-4fa8-9c0c-7e33289ea644 tempest-VolumesTransfersV357Test-1495175030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-73a09597-3ac3-41ef-a9de-ad7204954a62 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:33 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] Created reservations ['dd674245-6844-45c3-b537-a80875fd115f', '2bea2fdf-ef49-4faf-ae46-958d3f214ebf', '4a607593-2c3c-4d1a-becf-a9e5df6fbbab', '41748305-31d7-4119-9a7f-e73a219c689e'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:53:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ae53fc34-eff4-4fa8-9c0c-7e33289ea644 tempest-VolumesTransfersV357Test-1495175030 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-73a09597-3ac3-41ef-a9de-ad7204954a62" returned: 0 in 0.590s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ae53fc34-eff4-4fa8-9c0c-7e33289ea644 tempest-VolumesTransfersV357Test-1495175030 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-73a09597-3ac3-41ef-a9de-ad7204954a62 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:34 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] Delete snapshot completed successfully.
Sep 18 11:53:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ae53fc34-eff4-4fa8-9c0c-7e33289ea644 tempest-VolumesTransfersV357Test-1495175030 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-73a09597-3ac3-41ef-a9de-ad7204954a62" returned: 0 in 0.207s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:34 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] Lock "cinder-36997c8a-3ba2-4b15-95a5-d3e5dd9d2d5f-delete_snapshot" released by "delete_snapshot" :: held 2.708s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:53:34 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] Snapshots deleted, issuing volume delete {{(pid=83176) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 18 11:53:34 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] Acquiring lock "cinder-quobyte-2f01e9a7-28f0-4465-af38-84e8e17f79d5" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:53:34 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ae53fc34-eff4-4fa8-9c0c-7e33289ea644 tempest-VolumesTransfersV357Test-1495175030 None] Lock "cinder-quobyte-73a09597-3ac3-41ef-a9de-ad7204954a62" released by "delete_volume" :: held 0.900s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:53:34 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] Lock "cinder-quobyte-2f01e9a7-28f0-4465-af38-84e8e17f79d5" acquired by "delete_volume" :: waited 0.145s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:53:34 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4785e616-37da-4795-aca4-e5cf7b4d3ec8]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:53:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:34 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-ae53fc34-eff4-4fa8-9c0c-7e33289ea644 tempest-VolumesTransfersV357Test-1495175030 None] Created reservations ['e4d74b4d-a20f-4c11-abd8-ec4767250351', '75d1486b-4e68-46e0-b5ad-f1007e10ed7a', '1a3a9dd9-d250-440a-97f2-32c507176a65', 'f8ca8ab0-15e2-4e3a-a9c7-e566ac66446c'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:53:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ae53fc34-eff4-4fa8-9c0c-7e33289ea644 tempest-VolumesTransfersV357Test-1495175030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:53:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ae53fc34-eff4-4fa8-9c0c-7e33289ea644 tempest-VolumesTransfersV357Test-1495175030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:53:35 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-ae53fc34-eff4-4fa8-9c0c-7e33289ea644 tempest-VolumesTransfersV357Test-1495175030 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:53:35 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-ae53fc34-eff4-4fa8-9c0c-7e33289ea644 tempest-VolumesTransfersV357Test-1495175030 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:53:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ae53fc34-eff4-4fa8-9c0c-7e33289ea644 tempest-VolumesTransfersV357Test-1495175030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:53:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ae53fc34-eff4-4fa8-9c0c-7e33289ea644 tempest-VolumesTransfersV357Test-1495175030 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5" returned: 0 in 0.604s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ae53fc34-eff4-4fa8-9c0c-7e33289ea644 tempest-VolumesTransfersV357Test-1495175030 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.177s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:35 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-ae53fc34-eff4-4fa8-9c0c-7e33289ea644 tempest-VolumesTransfersV357Test-1495175030 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:53:35 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-ae53fc34-eff4-4fa8-9c0c-7e33289ea644 tempest-VolumesTransfersV357Test-1495175030 None] Deleted volume successfully.
Sep 18 11:53:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2f01e9a7-28f0-4465-af38-84e8e17f79d5" returned: 0 in 0.289s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:35 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] Lock "cinder-quobyte-2f01e9a7-28f0-4465-af38-84e8e17f79d5" released by "delete_volume" :: held 1.038s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:53:35 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ae53fc34-eff4-4fa8-9c0c-7e33289ea644 tempest-VolumesTransfersV357Test-1495175030 None] Lock "cinder-73a09597-3ac3-41ef-a9de-ad7204954a62-delete_volume" released by "delete_volume" :: held 2.769s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:53:35 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] Created reservations ['807bb0e8-8c6b-4525-8650-93ced8588af8', 'aaa80521-a399-4525-a319-d4063a34b81f', 'b2214dbd-a8a7-4cfa-aa4c-5dc5c528b221', 'bad69669-b21b-40a4-8880-cdb35aa3924b'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:53:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:53:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:53:35 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:53:35 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:53:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:53:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.185s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:35 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:53:36 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] Deleted volume successfully.
Sep 18 11:53:36 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-1901f449-9e10-4fe6-b816-ec42d1d15e90 tempest-VolumesDeleteCascade-63270987 None] Lock "cinder-2f01e9a7-28f0-4465-af38-84e8e17f79d5-delete_volume" released by "delete_volume" :: held 4.856s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:53:36 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-297cbf6c-572f-46d2-b1c0-d0ab71e8469a tempest-VolumesDeleteCascade-63270987 None] Acquiring lock "cinder-1373cc8c-ccb7-4393-9fe4-823486fbeb21-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:53:36 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-297cbf6c-572f-46d2-b1c0-d0ab71e8469a tempest-VolumesDeleteCascade-63270987 None] Lock "cinder-1373cc8c-ccb7-4393-9fe4-823486fbeb21-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:53:36 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-297cbf6c-572f-46d2-b1c0-d0ab71e8469a tempest-VolumesDeleteCascade-63270987 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:53:36 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-297cbf6c-572f-46d2-b1c0-d0ab71e8469a tempest-VolumesDeleteCascade-63270987 None] Acquiring lock "cinder-quobyte-1373cc8c-ccb7-4393-9fe4-823486fbeb21" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:53:36 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-297cbf6c-572f-46d2-b1c0-d0ab71e8469a tempest-VolumesDeleteCascade-63270987 None] Lock "cinder-quobyte-1373cc8c-ccb7-4393-9fe4-823486fbeb21" acquired by "delete_volume" :: waited 0.017s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:53:36 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[59dc6072-1152-4976-adad-9980020b6891]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:53:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-297cbf6c-572f-46d2-b1c0-d0ab71e8469a tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1373cc8c-ccb7-4393-9fe4-823486fbeb21 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-297cbf6c-572f-46d2-b1c0-d0ab71e8469a tempest-VolumesDeleteCascade-63270987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1373cc8c-ccb7-4393-9fe4-823486fbeb21" returned: 0 in 0.429s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-297cbf6c-572f-46d2-b1c0-d0ab71e8469a tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1373cc8c-ccb7-4393-9fe4-823486fbeb21 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-297cbf6c-572f-46d2-b1c0-d0ab71e8469a tempest-VolumesDeleteCascade-63270987 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1373cc8c-ccb7-4393-9fe4-823486fbeb21" returned: 0 in 0.134s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:37 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-297cbf6c-572f-46d2-b1c0-d0ab71e8469a tempest-VolumesDeleteCascade-63270987 None] Lock "cinder-quobyte-1373cc8c-ccb7-4393-9fe4-823486fbeb21" released by "delete_volume" :: held 0.734s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:53:37 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-297cbf6c-572f-46d2-b1c0-d0ab71e8469a tempest-VolumesDeleteCascade-63270987 None] Created reservations ['7caeb578-75e1-403c-a2bf-da883498e5b6', 'fa7738b6-c8d3-47aa-9742-860ca8bfc655', '01b8342e-6705-4634-beff-a63b753315bb', '745fef45-e28a-4478-a407-ba49767e9e42'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:53:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-297cbf6c-572f-46d2-b1c0-d0ab71e8469a tempest-VolumesDeleteCascade-63270987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:53:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-297cbf6c-572f-46d2-b1c0-d0ab71e8469a tempest-VolumesDeleteCascade-63270987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:53:37 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-297cbf6c-572f-46d2-b1c0-d0ab71e8469a tempest-VolumesDeleteCascade-63270987 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:53:37 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-297cbf6c-572f-46d2-b1c0-d0ab71e8469a tempest-VolumesDeleteCascade-63270987 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:53:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-297cbf6c-572f-46d2-b1c0-d0ab71e8469a tempest-VolumesDeleteCascade-63270987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:53:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-297cbf6c-572f-46d2-b1c0-d0ab71e8469a tempest-VolumesDeleteCascade-63270987 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-297cbf6c-572f-46d2-b1c0-d0ab71e8469a tempest-VolumesDeleteCascade-63270987 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.110s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:37 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-297cbf6c-572f-46d2-b1c0-d0ab71e8469a tempest-VolumesDeleteCascade-63270987 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:53:37 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-297cbf6c-572f-46d2-b1c0-d0ab71e8469a tempest-VolumesDeleteCascade-63270987 None] Deleted volume successfully.
Sep 18 11:53:38 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-297cbf6c-572f-46d2-b1c0-d0ab71e8469a tempest-VolumesDeleteCascade-63270987 None] Lock "cinder-1373cc8c-ccb7-4393-9fe4-823486fbeb21-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:53:42 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-cbd57065-7079-44bb-89ed-aaf36cacb4ce tempest-VolumesMetadataTest-1479035225 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:53:42 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbd57065-7079-44bb-89ed-aaf36cacb4ce tempest-VolumesMetadataTest-1479035225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:53:43 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-cbd57065-7079-44bb-89ed-aaf36cacb4ce tempest-VolumesMetadataTest-1479035225 None] Flow 'volume_create_manager' (c80b3421-9f93-4df9-bf80-24f7a8d49a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:53:43 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-cbd57065-7079-44bb-89ed-aaf36cacb4ce tempest-VolumesMetadataTest-1479035225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22d6802b-e831-489a-a47e-567761ab2d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:43 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-cbd57065-7079-44bb-89ed-aaf36cacb4ce tempest-VolumesMetadataTest-1479035225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22d6802b-e831-489a-a47e-567761ab2d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1745330402',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0c04c84-b37f-417e-8ede-920ff40e7f58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f7a4c70b1d94dc98215cc6012be84ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:53:42Z,use_quota=True,user_id='eb58a4aa4fd9472d83ff4f43788489fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:43 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-cbd57065-7079-44bb-89ed-aaf36cacb4ce tempest-VolumesMetadataTest-1479035225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65042348-30f4-4e9d-bdfe-f399237af707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:43 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-cbd57065-7079-44bb-89ed-aaf36cacb4ce tempest-VolumesMetadataTest-1479035225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65042348-30f4-4e9d-bdfe-f399237af707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:43 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-cbd57065-7079-44bb-89ed-aaf36cacb4ce tempest-VolumesMetadataTest-1479035225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c1f8766-50d3-4bdf-9f49-1789786ea8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:43 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-cbd57065-7079-44bb-89ed-aaf36cacb4ce tempest-VolumesMetadataTest-1479035225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c1f8766-50d3-4bdf-9f49-1789786ea8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0c04c84-b37f-417e-8ede-920ff40e7f58', 'volume_name': 'volume-a0c04c84-b37f-417e-8ede-920ff40e7f58', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:43 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-cbd57065-7079-44bb-89ed-aaf36cacb4ce tempest-VolumesMetadataTest-1479035225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3b4b09f-377f-44a7-a107-4e92ad9700fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:43 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-cbd57065-7079-44bb-89ed-aaf36cacb4ce tempest-VolumesMetadataTest-1479035225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3b4b09f-377f-44a7-a107-4e92ad9700fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:43 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-cbd57065-7079-44bb-89ed-aaf36cacb4ce tempest-VolumesMetadataTest-1479035225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3534169e-4315-47c1-8d71-0db2c54448ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:43 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-cbd57065-7079-44bb-89ed-aaf36cacb4ce tempest-VolumesMetadataTest-1479035225 None] Volume a0c04c84-b37f-417e-8ede-920ff40e7f58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0c04c84-b37f-417e-8ede-920ff40e7f58', 'volume_size': 1}
Sep 18 11:53:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-cbd57065-7079-44bb-89ed-aaf36cacb4ce tempest-VolumesMetadataTest-1479035225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:53:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-cbd57065-7079-44bb-89ed-aaf36cacb4ce tempest-VolumesMetadataTest-1479035225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:53:43 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-cbd57065-7079-44bb-89ed-aaf36cacb4ce tempest-VolumesMetadataTest-1479035225 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1745330402',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0c04c84-b37f-417e-8ede-920ff40e7f58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f7a4c70b1d94dc98215cc6012be84ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:53:42Z,use_quota=True,user_id='eb58a4aa4fd9472d83ff4f43788489fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:53:43 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-cbd57065-7079-44bb-89ed-aaf36cacb4ce tempest-VolumesMetadataTest-1479035225 None] Creating volume a0c04c84-b37f-417e-8ede-920ff40e7f58 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:53:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-cbd57065-7079-44bb-89ed-aaf36cacb4ce tempest-VolumesMetadataTest-1479035225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:53:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-cbd57065-7079-44bb-89ed-aaf36cacb4ce tempest-VolumesMetadataTest-1479035225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:53:43 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-cbd57065-7079-44bb-89ed-aaf36cacb4ce tempest-VolumesMetadataTest-1479035225 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:53:43 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-cbd57065-7079-44bb-89ed-aaf36cacb4ce tempest-VolumesMetadataTest-1479035225 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:53:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-cbd57065-7079-44bb-89ed-aaf36cacb4ce tempest-VolumesMetadataTest-1479035225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:53:43 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-cbd57065-7079-44bb-89ed-aaf36cacb4ce tempest-VolumesMetadataTest-1479035225 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:53:43 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-cbd57065-7079-44bb-89ed-aaf36cacb4ce tempest-VolumesMetadataTest-1479035225 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:53:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-cbd57065-7079-44bb-89ed-aaf36cacb4ce tempest-VolumesMetadataTest-1479035225 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a0c04c84-b37f-417e-8ede-920ff40e7f58 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:43 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=108, name=volume-a0c04c84-b37f-417e-8ede-920ff40e7f58, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:53:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-cbd57065-7079-44bb-89ed-aaf36cacb4ce tempest-VolumesMetadataTest-1479035225 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a0c04c84-b37f-417e-8ede-920ff40e7f58 1073741824" returned: 0 in 0.478s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-cbd57065-7079-44bb-89ed-aaf36cacb4ce tempest-VolumesMetadataTest-1479035225 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a0c04c84-b37f-417e-8ede-920ff40e7f58 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-cbd57065-7079-44bb-89ed-aaf36cacb4ce tempest-VolumesMetadataTest-1479035225 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a0c04c84-b37f-417e-8ede-920ff40e7f58" returned: 0 in 0.109s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:44 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-cbd57065-7079-44bb-89ed-aaf36cacb4ce tempest-VolumesMetadataTest-1479035225 None] <== create_volume: return (706ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:53:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-cbd57065-7079-44bb-89ed-aaf36cacb4ce tempest-VolumesMetadataTest-1479035225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:53:44 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-cbd57065-7079-44bb-89ed-aaf36cacb4ce tempest-VolumesMetadataTest-1479035225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3534169e-4315-47c1-8d71-0db2c54448ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0c04c84-b37f-417e-8ede-920ff40e7f58', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:44 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-cbd57065-7079-44bb-89ed-aaf36cacb4ce tempest-VolumesMetadataTest-1479035225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9f8062f-5554-4034-888d-183b7f0b3aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:44 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-cbd57065-7079-44bb-89ed-aaf36cacb4ce tempest-VolumesMetadataTest-1479035225 None] Volume volume-a0c04c84-b37f-417e-8ede-920ff40e7f58 (a0c04c84-b37f-417e-8ede-920ff40e7f58): created successfully
Sep 18 11:53:44 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-cbd57065-7079-44bb-89ed-aaf36cacb4ce tempest-VolumesMetadataTest-1479035225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9f8062f-5554-4034-888d-183b7f0b3aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:44 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-cbd57065-7079-44bb-89ed-aaf36cacb4ce tempest-VolumesMetadataTest-1479035225 None] Flow 'volume_create_manager' (c80b3421-9f93-4df9-bf80-24f7a8d49a2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:53:44 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-cbd57065-7079-44bb-89ed-aaf36cacb4ce tempest-VolumesMetadataTest-1479035225 None] Created volume successfully.
Sep 18 11:53:45 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-8deb8a93-ba21-4ba4-9679-e57512175a40 tempest-VolumesMetadataTest-1479035225 None] Acquiring lock "cinder-a0c04c84-b37f-417e-8ede-920ff40e7f58-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:53:46 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-8deb8a93-ba21-4ba4-9679-e57512175a40 tempest-VolumesMetadataTest-1479035225 None] Lock "cinder-a0c04c84-b37f-417e-8ede-920ff40e7f58-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:53:46 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-8deb8a93-ba21-4ba4-9679-e57512175a40 tempest-VolumesMetadataTest-1479035225 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:53:46 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-8deb8a93-ba21-4ba4-9679-e57512175a40 tempest-VolumesMetadataTest-1479035225 None] Acquiring lock "cinder-quobyte-a0c04c84-b37f-417e-8ede-920ff40e7f58" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:53:46 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-8deb8a93-ba21-4ba4-9679-e57512175a40 tempest-VolumesMetadataTest-1479035225 None] Lock "cinder-quobyte-a0c04c84-b37f-417e-8ede-920ff40e7f58" acquired by "delete_volume" :: waited 0.029s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:53:46 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[480602b3-5cf8-447e-96a4-3de714c13606]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:53:46 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8deb8a93-ba21-4ba4-9679-e57512175a40 tempest-VolumesMetadataTest-1479035225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a0c04c84-b37f-417e-8ede-920ff40e7f58 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:46 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8deb8a93-ba21-4ba4-9679-e57512175a40 tempest-VolumesMetadataTest-1479035225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a0c04c84-b37f-417e-8ede-920ff40e7f58" returned: 0 in 0.507s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:46 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8deb8a93-ba21-4ba4-9679-e57512175a40 tempest-VolumesMetadataTest-1479035225 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a0c04c84-b37f-417e-8ede-920ff40e7f58 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:46 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8deb8a93-ba21-4ba4-9679-e57512175a40 tempest-VolumesMetadataTest-1479035225 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a0c04c84-b37f-417e-8ede-920ff40e7f58" returned: 0 in 0.099s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:47 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-8deb8a93-ba21-4ba4-9679-e57512175a40 tempest-VolumesMetadataTest-1479035225 None] Lock "cinder-quobyte-a0c04c84-b37f-417e-8ede-920ff40e7f58" released by "delete_volume" :: held 0.777s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:53:47 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-8deb8a93-ba21-4ba4-9679-e57512175a40 tempest-VolumesMetadataTest-1479035225 None] Created reservations ['001bac73-5b63-4cd7-94ac-d3f4a21215bf', '973991c2-7cf6-479b-ac5f-eefcc2053f62', 'e634f43a-bba1-4b6b-b9fe-770939be3af8', 'dbb7b477-edaa-46a0-8c84-c87e839e7da9'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:53:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-8deb8a93-ba21-4ba4-9679-e57512175a40 tempest-VolumesMetadataTest-1479035225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:53:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-8deb8a93-ba21-4ba4-9679-e57512175a40 tempest-VolumesMetadataTest-1479035225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:53:47 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-8deb8a93-ba21-4ba4-9679-e57512175a40 tempest-VolumesMetadataTest-1479035225 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:53:47 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-8deb8a93-ba21-4ba4-9679-e57512175a40 tempest-VolumesMetadataTest-1479035225 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:53:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-8deb8a93-ba21-4ba4-9679-e57512175a40 tempest-VolumesMetadataTest-1479035225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:53:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8deb8a93-ba21-4ba4-9679-e57512175a40 tempest-VolumesMetadataTest-1479035225 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8deb8a93-ba21-4ba4-9679-e57512175a40 tempest-VolumesMetadataTest-1479035225 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.101s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:47 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-8deb8a93-ba21-4ba4-9679-e57512175a40 tempest-VolumesMetadataTest-1479035225 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:53:47 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-8deb8a93-ba21-4ba4-9679-e57512175a40 tempest-VolumesMetadataTest-1479035225 None] Deleted volume successfully.
Sep 18 11:53:47 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-8deb8a93-ba21-4ba4-9679-e57512175a40 tempest-VolumesMetadataTest-1479035225 None] Lock "cinder-a0c04c84-b37f-417e-8ede-920ff40e7f58-delete_volume" released by "delete_volume" :: held 1.818s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:53:54 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-4b7a0a21-4612-468e-8dec-ff68187e62c3 tempest-VolumesTransfersTest-284196165 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:53:54 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b7a0a21-4612-468e-8dec-ff68187e62c3 tempest-VolumesTransfersTest-284196165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:53:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4b7a0a21-4612-468e-8dec-ff68187e62c3 tempest-VolumesTransfersTest-284196165 None] Flow 'volume_create_manager' (eb441e12-b0b5-41e2-b3a9-6f3ebc6e109c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:53:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4b7a0a21-4612-468e-8dec-ff68187e62c3 tempest-VolumesTransfersTest-284196165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03dc14a0-622d-43c0-95e9-3bf3be909599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4b7a0a21-4612-468e-8dec-ff68187e62c3 tempest-VolumesTransfersTest-284196165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03dc14a0-622d-43c0-95e9-3bf3be909599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1303441671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f171983-03ea-48cc-a922-41acfeaf4019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b69873134cc4b61bebdfbe2e9a229e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:53:55Z,use_quota=True,user_id='716c9bc00e6e4ea18e3d6d8c56128dfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4b7a0a21-4612-468e-8dec-ff68187e62c3 tempest-VolumesTransfersTest-284196165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2552007-6f9c-4005-9159-75b64599acab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4b7a0a21-4612-468e-8dec-ff68187e62c3 tempest-VolumesTransfersTest-284196165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2552007-6f9c-4005-9159-75b64599acab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4b7a0a21-4612-468e-8dec-ff68187e62c3 tempest-VolumesTransfersTest-284196165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a00c785e-c5b3-48b4-be75-df8a9437246b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4b7a0a21-4612-468e-8dec-ff68187e62c3 tempest-VolumesTransfersTest-284196165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a00c785e-c5b3-48b4-be75-df8a9437246b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f171983-03ea-48cc-a922-41acfeaf4019', 'volume_name': 'volume-3f171983-03ea-48cc-a922-41acfeaf4019', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4b7a0a21-4612-468e-8dec-ff68187e62c3 tempest-VolumesTransfersTest-284196165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c70c34d-74b3-4e48-9d30-730c97dcab8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4b7a0a21-4612-468e-8dec-ff68187e62c3 tempest-VolumesTransfersTest-284196165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c70c34d-74b3-4e48-9d30-730c97dcab8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4b7a0a21-4612-468e-8dec-ff68187e62c3 tempest-VolumesTransfersTest-284196165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb17b806-91f2-47ef-a631-72fc57469955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:54 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-4b7a0a21-4612-468e-8dec-ff68187e62c3 tempest-VolumesTransfersTest-284196165 None] Volume 3f171983-03ea-48cc-a922-41acfeaf4019: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f171983-03ea-48cc-a922-41acfeaf4019', 'volume_size': 1}
Sep 18 11:53:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4b7a0a21-4612-468e-8dec-ff68187e62c3 tempest-VolumesTransfersTest-284196165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:53:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4b7a0a21-4612-468e-8dec-ff68187e62c3 tempest-VolumesTransfersTest-284196165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:53:54 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-4b7a0a21-4612-468e-8dec-ff68187e62c3 tempest-VolumesTransfersTest-284196165 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1303441671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f171983-03ea-48cc-a922-41acfeaf4019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b69873134cc4b61bebdfbe2e9a229e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:53:55Z,use_quota=True,user_id='716c9bc00e6e4ea18e3d6d8c56128dfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:53:54 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-4b7a0a21-4612-468e-8dec-ff68187e62c3 tempest-VolumesTransfersTest-284196165 None] Creating volume 3f171983-03ea-48cc-a922-41acfeaf4019 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:53:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4b7a0a21-4612-468e-8dec-ff68187e62c3 tempest-VolumesTransfersTest-284196165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:53:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4b7a0a21-4612-468e-8dec-ff68187e62c3 tempest-VolumesTransfersTest-284196165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:53:54 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-4b7a0a21-4612-468e-8dec-ff68187e62c3 tempest-VolumesTransfersTest-284196165 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:53:54 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-4b7a0a21-4612-468e-8dec-ff68187e62c3 tempest-VolumesTransfersTest-284196165 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:53:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4b7a0a21-4612-468e-8dec-ff68187e62c3 tempest-VolumesTransfersTest-284196165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:53:54 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-4b7a0a21-4612-468e-8dec-ff68187e62c3 tempest-VolumesTransfersTest-284196165 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:53:54 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-4b7a0a21-4612-468e-8dec-ff68187e62c3 tempest-VolumesTransfersTest-284196165 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:53:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4b7a0a21-4612-468e-8dec-ff68187e62c3 tempest-VolumesTransfersTest-284196165 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-3f171983-03ea-48cc-a922-41acfeaf4019 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:55 devstack quobyte-client[83193]: System call of process 95007 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:53:55 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=109, name=volume-3f171983-03ea-48cc-a922-41acfeaf4019, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:53:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4b7a0a21-4612-468e-8dec-ff68187e62c3 tempest-VolumesTransfersTest-284196165 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-3f171983-03ea-48cc-a922-41acfeaf4019 1073741824" returned: 0 in 0.484s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4b7a0a21-4612-468e-8dec-ff68187e62c3 tempest-VolumesTransfersTest-284196165 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-3f171983-03ea-48cc-a922-41acfeaf4019 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4b7a0a21-4612-468e-8dec-ff68187e62c3 tempest-VolumesTransfersTest-284196165 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-3f171983-03ea-48cc-a922-41acfeaf4019" returned: 0 in 0.159s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:55 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-4b7a0a21-4612-468e-8dec-ff68187e62c3 tempest-VolumesTransfersTest-284196165 None] <== create_volume: return (725ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:53:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4b7a0a21-4612-468e-8dec-ff68187e62c3 tempest-VolumesTransfersTest-284196165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:53:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4b7a0a21-4612-468e-8dec-ff68187e62c3 tempest-VolumesTransfersTest-284196165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb17b806-91f2-47ef-a631-72fc57469955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f171983-03ea-48cc-a922-41acfeaf4019', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4b7a0a21-4612-468e-8dec-ff68187e62c3 tempest-VolumesTransfersTest-284196165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b42f6145-31b1-484b-a959-79271b658800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:55 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-4b7a0a21-4612-468e-8dec-ff68187e62c3 tempest-VolumesTransfersTest-284196165 None] Volume volume-3f171983-03ea-48cc-a922-41acfeaf4019 (3f171983-03ea-48cc-a922-41acfeaf4019): created successfully
Sep 18 11:53:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4b7a0a21-4612-468e-8dec-ff68187e62c3 tempest-VolumesTransfersTest-284196165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b42f6145-31b1-484b-a959-79271b658800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:56 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4b7a0a21-4612-468e-8dec-ff68187e62c3 tempest-VolumesTransfersTest-284196165 None] Flow 'volume_create_manager' (eb441e12-b0b5-41e2-b3a9-6f3ebc6e109c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:53:56 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-4b7a0a21-4612-468e-8dec-ff68187e62c3 tempest-VolumesTransfersTest-284196165 None] Created volume successfully.
Sep 18 11:53:57 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-1b7aa6f9-361e-42d6-9a8b-396f4d6e0939 tempest-VolumesActionsTest-1897970757 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:53:57 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b7aa6f9-361e-42d6-9a8b-396f4d6e0939 tempest-VolumesActionsTest-1897970757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:53:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1b7aa6f9-361e-42d6-9a8b-396f4d6e0939 tempest-VolumesActionsTest-1897970757 None] Flow 'volume_create_manager' (f05b57e7-b79c-477d-8c92-aa7906198037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:53:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1b7aa6f9-361e-42d6-9a8b-396f4d6e0939 tempest-VolumesActionsTest-1897970757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (046ed06d-5d0d-47c8-92a0-8988e5c77fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:57 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-1e3b78a5-c0c3-45a0-b540-4773902abbc0 tempest-VolumesTransfersTest-1861624989 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:53:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1b7aa6f9-361e-42d6-9a8b-396f4d6e0939 tempest-VolumesActionsTest-1897970757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (046ed06d-5d0d-47c8-92a0-8988e5c77fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1431191358',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48dbf52d-c9a0-4777-bc2b-ea232f24fdb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39d098ec352a46e59553e2ee3ec104cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:53:57Z,use_quota=True,user_id='4bd39c311da44300b3889ccd13515f1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1b7aa6f9-361e-42d6-9a8b-396f4d6e0939 tempest-VolumesActionsTest-1897970757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1c8dbac-b11c-4603-b62a-5de9d7f8f068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1b7aa6f9-361e-42d6-9a8b-396f4d6e0939 tempest-VolumesActionsTest-1897970757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1c8dbac-b11c-4603-b62a-5de9d7f8f068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1b7aa6f9-361e-42d6-9a8b-396f4d6e0939 tempest-VolumesActionsTest-1897970757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fd8cafa-1e6d-4f02-91b0-a98ccc20cdde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1b7aa6f9-361e-42d6-9a8b-396f4d6e0939 tempest-VolumesActionsTest-1897970757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fd8cafa-1e6d-4f02-91b0-a98ccc20cdde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48dbf52d-c9a0-4777-bc2b-ea232f24fdb1', 'volume_name': 'volume-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1b7aa6f9-361e-42d6-9a8b-396f4d6e0939 tempest-VolumesActionsTest-1897970757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (389f5c51-7569-4eeb-8fae-1e00d2237275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1b7aa6f9-361e-42d6-9a8b-396f4d6e0939 tempest-VolumesActionsTest-1897970757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (389f5c51-7569-4eeb-8fae-1e00d2237275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1b7aa6f9-361e-42d6-9a8b-396f4d6e0939 tempest-VolumesActionsTest-1897970757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fedba9b-20e3-479e-ad26-c5f67492313a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:57 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-1b7aa6f9-361e-42d6-9a8b-396f4d6e0939 tempest-VolumesActionsTest-1897970757 None] Volume 48dbf52d-c9a0-4777-bc2b-ea232f24fdb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1', 'volume_size': 1}
Sep 18 11:53:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1b7aa6f9-361e-42d6-9a8b-396f4d6e0939 tempest-VolumesActionsTest-1897970757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:53:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1b7aa6f9-361e-42d6-9a8b-396f4d6e0939 tempest-VolumesActionsTest-1897970757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:53:57 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-1b7aa6f9-361e-42d6-9a8b-396f4d6e0939 tempest-VolumesActionsTest-1897970757 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1431191358',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48dbf52d-c9a0-4777-bc2b-ea232f24fdb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39d098ec352a46e59553e2ee3ec104cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:53:57Z,use_quota=True,user_id='4bd39c311da44300b3889ccd13515f1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:53:57 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-1b7aa6f9-361e-42d6-9a8b-396f4d6e0939 tempest-VolumesActionsTest-1897970757 None] Creating volume 48dbf52d-c9a0-4777-bc2b-ea232f24fdb1 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:53:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1b7aa6f9-361e-42d6-9a8b-396f4d6e0939 tempest-VolumesActionsTest-1897970757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:53:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1b7aa6f9-361e-42d6-9a8b-396f4d6e0939 tempest-VolumesActionsTest-1897970757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:53:57 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-1b7aa6f9-361e-42d6-9a8b-396f4d6e0939 tempest-VolumesActionsTest-1897970757 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:53:57 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-1b7aa6f9-361e-42d6-9a8b-396f4d6e0939 tempest-VolumesActionsTest-1897970757 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:53:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1b7aa6f9-361e-42d6-9a8b-396f4d6e0939 tempest-VolumesActionsTest-1897970757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:53:57 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-1b7aa6f9-361e-42d6-9a8b-396f4d6e0939 tempest-VolumesActionsTest-1897970757 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:53:57 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-1b7aa6f9-361e-42d6-9a8b-396f4d6e0939 tempest-VolumesActionsTest-1897970757 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:53:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1b7aa6f9-361e-42d6-9a8b-396f4d6e0939 tempest-VolumesActionsTest-1897970757 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:57 devstack quobyte-client[83193]: System call of process 95012 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:53:57 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-1e3b78a5-c0c3-45a0-b540-4773902abbc0 tempest-VolumesTransfersTest-1861624989 None] Transfer volume completed successfully.
Sep 18 11:53:57 devstack quobyte-client[83193]: System call of process 95012 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:53:57 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=110, name=volume-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:53:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1b7aa6f9-361e-42d6-9a8b-396f4d6e0939 tempest-VolumesActionsTest-1897970757 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1 1073741824" returned: 0 in 0.384s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1b7aa6f9-361e-42d6-9a8b-396f4d6e0939 tempest-VolumesActionsTest-1897970757 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1b7aa6f9-361e-42d6-9a8b-396f4d6e0939 tempest-VolumesActionsTest-1897970757 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1" returned: 0 in 0.136s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:58 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-1b7aa6f9-361e-42d6-9a8b-396f4d6e0939 tempest-VolumesActionsTest-1897970757 None] <== create_volume: return (564ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:53:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1b7aa6f9-361e-42d6-9a8b-396f4d6e0939 tempest-VolumesActionsTest-1897970757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.575s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:53:58 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1b7aa6f9-361e-42d6-9a8b-396f4d6e0939 tempest-VolumesActionsTest-1897970757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fedba9b-20e3-479e-ad26-c5f67492313a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:58 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1b7aa6f9-361e-42d6-9a8b-396f4d6e0939 tempest-VolumesActionsTest-1897970757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c352b25d-8963-4064-9429-b0d073ec426c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:53:58 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-1b7aa6f9-361e-42d6-9a8b-396f4d6e0939 tempest-VolumesActionsTest-1897970757 None] Volume volume-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1 (48dbf52d-c9a0-4777-bc2b-ea232f24fdb1): created successfully
Sep 18 11:53:58 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1b7aa6f9-361e-42d6-9a8b-396f4d6e0939 tempest-VolumesActionsTest-1897970757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c352b25d-8963-4064-9429-b0d073ec426c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:53:58 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1b7aa6f9-361e-42d6-9a8b-396f4d6e0939 tempest-VolumesActionsTest-1897970757 None] Flow 'volume_create_manager' (f05b57e7-b79c-477d-8c92-aa7906198037) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:53:58 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-1b7aa6f9-361e-42d6-9a8b-396f4d6e0939 tempest-VolumesActionsTest-1897970757 None] Created volume successfully.
Sep 18 11:53:58 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-fc5e942b-7f62-485e-a5d5-9d4b31396b45 tempest-VolumesTransfersTest-2077592872 None] Acquiring lock "cinder-3f171983-03ea-48cc-a922-41acfeaf4019-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:53:58 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-fc5e942b-7f62-485e-a5d5-9d4b31396b45 tempest-VolumesTransfersTest-2077592872 None] Lock "cinder-3f171983-03ea-48cc-a922-41acfeaf4019-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:53:58 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-fc5e942b-7f62-485e-a5d5-9d4b31396b45 tempest-VolumesTransfersTest-2077592872 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:53:58 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-fc5e942b-7f62-485e-a5d5-9d4b31396b45 tempest-VolumesTransfersTest-2077592872 None] Acquiring lock "cinder-quobyte-3f171983-03ea-48cc-a922-41acfeaf4019" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:53:58 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-fc5e942b-7f62-485e-a5d5-9d4b31396b45 tempest-VolumesTransfersTest-2077592872 None] Lock "cinder-quobyte-3f171983-03ea-48cc-a922-41acfeaf4019" acquired by "delete_volume" :: waited 0.012s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:53:58 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8005f5a9-da7c-4419-bdb1-7e7535754f9b]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:53:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fc5e942b-7f62-485e-a5d5-9d4b31396b45 tempest-VolumesTransfersTest-2077592872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-3f171983-03ea-48cc-a922-41acfeaf4019 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fc5e942b-7f62-485e-a5d5-9d4b31396b45 tempest-VolumesTransfersTest-2077592872 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-3f171983-03ea-48cc-a922-41acfeaf4019" returned: 0 in 0.399s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fc5e942b-7f62-485e-a5d5-9d4b31396b45 tempest-VolumesTransfersTest-2077592872 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-3f171983-03ea-48cc-a922-41acfeaf4019 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:53:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fc5e942b-7f62-485e-a5d5-9d4b31396b45 tempest-VolumesTransfersTest-2077592872 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-3f171983-03ea-48cc-a922-41acfeaf4019" returned: 0 in 0.102s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:53:59 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-fc5e942b-7f62-485e-a5d5-9d4b31396b45 tempest-VolumesTransfersTest-2077592872 None] Lock "cinder-quobyte-3f171983-03ea-48cc-a922-41acfeaf4019" released by "delete_volume" :: held 0.653s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:53:59 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-fc5e942b-7f62-485e-a5d5-9d4b31396b45 tempest-VolumesTransfersTest-2077592872 None] Created reservations ['736f4c7c-1d61-401e-918f-56ba46699b60', '9e382fbe-9494-4c38-b57d-156147311807', '0d691288-bf8e-43d0-a9bf-ab34943cb328', '164a274c-7a71-4688-844a-8ef104c4c88c'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:53:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-fc5e942b-7f62-485e-a5d5-9d4b31396b45 tempest-VolumesTransfersTest-2077592872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:53:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-fc5e942b-7f62-485e-a5d5-9d4b31396b45 tempest-VolumesTransfersTest-2077592872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:53:59 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-fc5e942b-7f62-485e-a5d5-9d4b31396b45 tempest-VolumesTransfersTest-2077592872 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:54:00 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-fc5e942b-7f62-485e-a5d5-9d4b31396b45 tempest-VolumesTransfersTest-2077592872 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:54:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-fc5e942b-7f62-485e-a5d5-9d4b31396b45 tempest-VolumesTransfersTest-2077592872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:54:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fc5e942b-7f62-485e-a5d5-9d4b31396b45 tempest-VolumesTransfersTest-2077592872 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fc5e942b-7f62-485e-a5d5-9d4b31396b45 tempest-VolumesTransfersTest-2077592872 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.115s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:00 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-fc5e942b-7f62-485e-a5d5-9d4b31396b45 tempest-VolumesTransfersTest-2077592872 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:54:00 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-fc5e942b-7f62-485e-a5d5-9d4b31396b45 tempest-VolumesTransfersTest-2077592872 None] Deleted volume successfully.
Sep 18 11:54:00 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-fc5e942b-7f62-485e-a5d5-9d4b31396b45 tempest-VolumesTransfersTest-2077592872 None] Lock "cinder-3f171983-03ea-48cc-a922-41acfeaf4019-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:54:01 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-1081d95b-1bcd-4199-8878-ec250419e333 tempest-VolumesTransfersTest-284196165 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:54:01 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-1081d95b-1bcd-4199-8878-ec250419e333 tempest-VolumesTransfersTest-284196165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:54:01 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1081d95b-1bcd-4199-8878-ec250419e333 tempest-VolumesTransfersTest-284196165 None] Flow 'volume_create_manager' (c1df7b44-cc14-4667-9380-03e959c58acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:54:01 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1081d95b-1bcd-4199-8878-ec250419e333 tempest-VolumesTransfersTest-284196165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c957889-fd04-4750-9490-d6710b5d257e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:54:01 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1081d95b-1bcd-4199-8878-ec250419e333 tempest-VolumesTransfersTest-284196165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c957889-fd04-4750-9490-d6710b5d257e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1687730386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f14c9001-cb32-49e6-adec-29e815bed06d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b69873134cc4b61bebdfbe2e9a229e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:54:02Z,use_quota=True,user_id='716c9bc00e6e4ea18e3d6d8c56128dfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:54:01 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1081d95b-1bcd-4199-8878-ec250419e333 tempest-VolumesTransfersTest-284196165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aca5e9b-85ee-446f-a12e-63457441a1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:54:01 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1081d95b-1bcd-4199-8878-ec250419e333 tempest-VolumesTransfersTest-284196165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aca5e9b-85ee-446f-a12e-63457441a1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:54:01 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1081d95b-1bcd-4199-8878-ec250419e333 tempest-VolumesTransfersTest-284196165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b164a722-dd4b-412f-97df-cd3cefc4cd90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:54:01 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1081d95b-1bcd-4199-8878-ec250419e333 tempest-VolumesTransfersTest-284196165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b164a722-dd4b-412f-97df-cd3cefc4cd90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f14c9001-cb32-49e6-adec-29e815bed06d', 'volume_name': 'volume-f14c9001-cb32-49e6-adec-29e815bed06d', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:54:01 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1081d95b-1bcd-4199-8878-ec250419e333 tempest-VolumesTransfersTest-284196165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21afbc54-4225-4f32-9e1f-85129e5bc054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:54:01 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1081d95b-1bcd-4199-8878-ec250419e333 tempest-VolumesTransfersTest-284196165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21afbc54-4225-4f32-9e1f-85129e5bc054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:54:01 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1081d95b-1bcd-4199-8878-ec250419e333 tempest-VolumesTransfersTest-284196165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d5b40c-ab2f-4989-9e24-623e4bcdf3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:54:01 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-1081d95b-1bcd-4199-8878-ec250419e333 tempest-VolumesTransfersTest-284196165 None] Volume f14c9001-cb32-49e6-adec-29e815bed06d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f14c9001-cb32-49e6-adec-29e815bed06d', 'volume_size': 1}
Sep 18 11:54:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1081d95b-1bcd-4199-8878-ec250419e333 tempest-VolumesTransfersTest-284196165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:54:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1081d95b-1bcd-4199-8878-ec250419e333 tempest-VolumesTransfersTest-284196165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:54:01 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-1081d95b-1bcd-4199-8878-ec250419e333 tempest-VolumesTransfersTest-284196165 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1687730386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f14c9001-cb32-49e6-adec-29e815bed06d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b69873134cc4b61bebdfbe2e9a229e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:54:02Z,use_quota=True,user_id='716c9bc00e6e4ea18e3d6d8c56128dfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:54:01 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-1081d95b-1bcd-4199-8878-ec250419e333 tempest-VolumesTransfersTest-284196165 None] Creating volume f14c9001-cb32-49e6-adec-29e815bed06d {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:54:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1081d95b-1bcd-4199-8878-ec250419e333 tempest-VolumesTransfersTest-284196165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:54:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1081d95b-1bcd-4199-8878-ec250419e333 tempest-VolumesTransfersTest-284196165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:54:01 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-1081d95b-1bcd-4199-8878-ec250419e333 tempest-VolumesTransfersTest-284196165 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:54:01 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-1081d95b-1bcd-4199-8878-ec250419e333 tempest-VolumesTransfersTest-284196165 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:54:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1081d95b-1bcd-4199-8878-ec250419e333 tempest-VolumesTransfersTest-284196165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:54:01 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-1081d95b-1bcd-4199-8878-ec250419e333 tempest-VolumesTransfersTest-284196165 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:54:01 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-1081d95b-1bcd-4199-8878-ec250419e333 tempest-VolumesTransfersTest-284196165 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:54:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1081d95b-1bcd-4199-8878-ec250419e333 tempest-VolumesTransfersTest-284196165 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f14c9001-cb32-49e6-adec-29e815bed06d 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:02 devstack quobyte-client[83193]: System call of process 95027 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:54:02 devstack quobyte-client[83193]: System call of process 95027 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:54:02 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=111, name=volume-f14c9001-cb32-49e6-adec-29e815bed06d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:54:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1081d95b-1bcd-4199-8878-ec250419e333 tempest-VolumesTransfersTest-284196165 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f14c9001-cb32-49e6-adec-29e815bed06d 1073741824" returned: 0 in 0.350s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1081d95b-1bcd-4199-8878-ec250419e333 tempest-VolumesTransfersTest-284196165 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f14c9001-cb32-49e6-adec-29e815bed06d {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1081d95b-1bcd-4199-8878-ec250419e333 tempest-VolumesTransfersTest-284196165 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f14c9001-cb32-49e6-adec-29e815bed06d" returned: 0 in 0.128s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:02 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-1081d95b-1bcd-4199-8878-ec250419e333 tempest-VolumesTransfersTest-284196165 None] <== create_volume: return (621ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:54:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1081d95b-1bcd-4199-8878-ec250419e333 tempest-VolumesTransfersTest-284196165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.633s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:54:02 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1081d95b-1bcd-4199-8878-ec250419e333 tempest-VolumesTransfersTest-284196165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d5b40c-ab2f-4989-9e24-623e4bcdf3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f14c9001-cb32-49e6-adec-29e815bed06d', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:54:02 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1081d95b-1bcd-4199-8878-ec250419e333 tempest-VolumesTransfersTest-284196165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fefe0ea6-c8ee-4332-8d68-67b4d2c3239e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:54:02 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-1081d95b-1bcd-4199-8878-ec250419e333 tempest-VolumesTransfersTest-284196165 None] Volume volume-f14c9001-cb32-49e6-adec-29e815bed06d (f14c9001-cb32-49e6-adec-29e815bed06d): created successfully
Sep 18 11:54:02 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1081d95b-1bcd-4199-8878-ec250419e333 tempest-VolumesTransfersTest-284196165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fefe0ea6-c8ee-4332-8d68-67b4d2c3239e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:54:02 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-1081d95b-1bcd-4199-8878-ec250419e333 tempest-VolumesTransfersTest-284196165 None] Flow 'volume_create_manager' (c1df7b44-cc14-4667-9380-03e959c58acd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:54:03 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-1081d95b-1bcd-4199-8878-ec250419e333 tempest-VolumesTransfersTest-284196165 None] Created volume successfully.
Sep 18 11:54:04 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-03af13b9-7241-4a05-94ae-7db14ebee2a7 tempest-VolumesTransfersTest-2077592872 None] Acquiring lock "cinder-f14c9001-cb32-49e6-adec-29e815bed06d-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:54:04 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-03af13b9-7241-4a05-94ae-7db14ebee2a7 tempest-VolumesTransfersTest-2077592872 None] Lock "cinder-f14c9001-cb32-49e6-adec-29e815bed06d-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:54:04 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-03af13b9-7241-4a05-94ae-7db14ebee2a7 tempest-VolumesTransfersTest-2077592872 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:54:04 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-03af13b9-7241-4a05-94ae-7db14ebee2a7 tempest-VolumesTransfersTest-2077592872 None] Acquiring lock "cinder-quobyte-f14c9001-cb32-49e6-adec-29e815bed06d" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:54:04 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-03af13b9-7241-4a05-94ae-7db14ebee2a7 tempest-VolumesTransfersTest-2077592872 None] Lock "cinder-quobyte-f14c9001-cb32-49e6-adec-29e815bed06d" acquired by "delete_volume" :: waited 0.012s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:54:04 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[823456c6-0737-4c05-8196-d4aae8ccf4cf]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:54:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-03af13b9-7241-4a05-94ae-7db14ebee2a7 tempest-VolumesTransfersTest-2077592872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f14c9001-cb32-49e6-adec-29e815bed06d {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:04 devstack quobyte-client[83193]: System call of process 95031 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:54:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-03af13b9-7241-4a05-94ae-7db14ebee2a7 tempest-VolumesTransfersTest-2077592872 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f14c9001-cb32-49e6-adec-29e815bed06d" returned: 0 in 0.442s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-03af13b9-7241-4a05-94ae-7db14ebee2a7 tempest-VolumesTransfersTest-2077592872 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f14c9001-cb32-49e6-adec-29e815bed06d {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-03af13b9-7241-4a05-94ae-7db14ebee2a7 tempest-VolumesTransfersTest-2077592872 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f14c9001-cb32-49e6-adec-29e815bed06d" returned: 0 in 0.105s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:05 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-03af13b9-7241-4a05-94ae-7db14ebee2a7 tempest-VolumesTransfersTest-2077592872 None] Lock "cinder-quobyte-f14c9001-cb32-49e6-adec-29e815bed06d" released by "delete_volume" :: held 0.685s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:54:05 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-03af13b9-7241-4a05-94ae-7db14ebee2a7 tempest-VolumesTransfersTest-2077592872 None] Created reservations ['4a2bf979-d25f-4d4d-8abf-013a24976545', '47b6d44e-e46b-439a-b73a-fb8c20a80b8a', 'bb8a10d1-afa8-48a0-9563-746bec7a10bb', '3674f8bb-7039-468c-86de-edfa0553f1ff'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:54:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-03af13b9-7241-4a05-94ae-7db14ebee2a7 tempest-VolumesTransfersTest-2077592872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:54:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-03af13b9-7241-4a05-94ae-7db14ebee2a7 tempest-VolumesTransfersTest-2077592872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:54:05 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-03af13b9-7241-4a05-94ae-7db14ebee2a7 tempest-VolumesTransfersTest-2077592872 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:54:05 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-03af13b9-7241-4a05-94ae-7db14ebee2a7 tempest-VolumesTransfersTest-2077592872 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:54:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-03af13b9-7241-4a05-94ae-7db14ebee2a7 tempest-VolumesTransfersTest-2077592872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:54:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-03af13b9-7241-4a05-94ae-7db14ebee2a7 tempest-VolumesTransfersTest-2077592872 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-03af13b9-7241-4a05-94ae-7db14ebee2a7 tempest-VolumesTransfersTest-2077592872 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.117s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:05 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-03af13b9-7241-4a05-94ae-7db14ebee2a7 tempest-VolumesTransfersTest-2077592872 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:54:05 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-03af13b9-7241-4a05-94ae-7db14ebee2a7 tempest-VolumesTransfersTest-2077592872 None] Deleted volume successfully.
Sep 18 11:54:05 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-03af13b9-7241-4a05-94ae-7db14ebee2a7 tempest-VolumesTransfersTest-2077592872 None] Lock "cinder-f14c9001-cb32-49e6-adec-29e815bed06d-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:54:13 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 11:54:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:54:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.020s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:54:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:54:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:54:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:54:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.125s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:14 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:54:14 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:UPDATE=86,cinder:SELECT=60,cinder:DELETE=11,cinder:INSERT=21 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:54:14 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:UPDATE=106,cinder:SELECT=61,cinder:INSERT=19,cinder:DELETE=7 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:54:14 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:54:14 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:54:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Flow 'volume_create_manager' (5f7e45a4-5ac0-45c2-a655-a65eab62fb6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:54:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d75228bf-481d-4c1c-8473-f5d97877823a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:54:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d75228bf-481d-4c1c-8473-f5d97877823a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-348126971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d27f096e-ab1f-49aa-84e9-f3c07530c0a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434bf4d46ad84fe793129101815910b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:54:14Z,use_quota=True,user_id='4e933a756f4849a88f9dde3096c9862e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:54:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5790a22-4a76-43dd-88a3-f08dcaac91dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:54:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5790a22-4a76-43dd-88a3-f08dcaac91dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:54:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ee00048-2d88-45e9-9432-b3c83ee0efc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:54:14 devstack cinder-volume[83176]: DEBUG cinder.image.glance [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Creating Keystone auth plugin from conf {{(pid=83176) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 18 11:54:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ee00048-2d88-45e9-9432-b3c83ee0efc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd27f096e-ab1f-49aa-84e9-f3c07530c0a8', 'volume_name': 'volume-d27f096e-ab1f-49aa-84e9-f3c07530c0a8', 'volume_size': 1, 'image_id': 'd8f06519-8e17-49ea-ac0c-4df29f548619', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8f06519-8e17-49ea-ac0c-4df29f548619', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '68bc9b408b424a06a12482824dcdb45c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8f06519-8e17-49ea-ac0c-4df29f548619', 'created_at': datetime.datetime(2025, 9, 18, 9, 18, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 9, 18, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8f06519-8e17-49ea-ac0c-4df29f548619/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6ada286c80>}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:54:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (775c7cf7-69df-44cf-97b4-839ca3d4223a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:54:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (775c7cf7-69df-44cf-97b4-839ca3d4223a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:54:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21c59f1b-dbed-49d7-905f-55c1fdbf06bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:54:15 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Volume d27f096e-ab1f-49aa-84e9-f3c07530c0a8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d27f096e-ab1f-49aa-84e9-f3c07530c0a8', 'volume_size': 1, 'image_id': 'd8f06519-8e17-49ea-ac0c-4df29f548619', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8f06519-8e17-49ea-ac0c-4df29f548619', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '68bc9b408b424a06a12482824dcdb45c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8f06519-8e17-49ea-ac0c-4df29f548619', 'created_at': datetime.datetime(2025, 9, 18, 9, 18, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 9, 18, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8f06519-8e17-49ea-ac0c-4df29f548619/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6ada286c80>}
Sep 18 11:54:15 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Cloning d27f096e-ab1f-49aa-84e9-f3c07530c0a8 from image d8f06519-8e17-49ea-ac0c-4df29f548619  at location (None, [{'url': 'file:///opt/stack/data/glance/images/d8f06519-8e17-49ea-ac0c-4df29f548619', 'metadata': {}}]). {{(pid=83176) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 18 11:54:15 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_t9sz7eybdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83176) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 18 11:54:15 devstack cinder-volume[83176]: INFO cinder.image.image_utils [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Image download 20.69 MB at 20.69 MB/s
Sep 18 11:54:15 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d61f2d-e494-4940-bf06-9b3f77f8c653]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:54:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_t9sz7eybdevstack@QuobyteHD {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:16 devstack sudo[95065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_t9sz7eybdevstack@QuobyteHD
Sep 18 11:54:16 devstack sudo[95065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:54:19 devstack sudo[95065]: pam_unix(sudo:session): session closed for user root
Sep 18 11:54:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_t9sz7eybdevstack@QuobyteHD" returned: 0 in 3.864s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:19 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Temporary image d8f06519-8e17-49ea-ac0c-4df29f548619 is fetched for user 4e933a756f4849a88f9dde3096c9862e. {{(pid=83176) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 18 11:54:20 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d161712d-9c6f-4e55-8592-8f5232c6ffbf]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:54:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_t9sz7eybdevstack@QuobyteHD {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:20 devstack sudo[95129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_t9sz7eybdevstack@QuobyteHD
Sep 18 11:54:20 devstack sudo[95129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:54:22 devstack sudo[95129]: pam_unix(sudo:session): session closed for user root
Sep 18 11:54:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_t9sz7eybdevstack@QuobyteHD" returned: 0 in 2.630s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:54:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:54:23 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-348126971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d27f096e-ab1f-49aa-84e9-f3c07530c0a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434bf4d46ad84fe793129101815910b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:54:14Z,use_quota=True,user_id='4e933a756f4849a88f9dde3096c9862e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:54:23 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Creating volume d27f096e-ab1f-49aa-84e9-f3c07530c0a8 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:54:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:54:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:54:23 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:54:23 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:54:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:54:23 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:54:23 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:54:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d27f096e-ab1f-49aa-84e9-f3c07530c0a8 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:23 devstack quobyte-client[83193]: System call of process 95145 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:54:23 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=112, name=volume-d27f096e-ab1f-49aa-84e9-f3c07530c0a8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:54:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d27f096e-ab1f-49aa-84e9-f3c07530c0a8 1073741824" returned: 0 in 0.398s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d27f096e-ab1f-49aa-84e9-f3c07530c0a8 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d27f096e-ab1f-49aa-84e9-f3c07530c0a8" returned: 0 in 0.147s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:23 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] <== create_volume: return (692ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:54:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:54:23 devstack cinder-volume[83176]: DEBUG cinder.volume.volume_utils [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Attempting download of d8f06519-8e17-49ea-ac0c-4df29f548619 ((None, [{'url': 'file:///opt/stack/data/glance/images/d8f06519-8e17-49ea-ac0c-4df29f548619', 'metadata': {}}])) to volume d27f096e-ab1f-49aa-84e9-f3c07530c0a8. {{(pid=83176) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 18 11:54:24 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[533f281e-b5d4-4acb-a30c-56e442533046]: (4, 'raw') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:54:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8f06519-8e17-49ea-ac0c-4df29f548619_npgthk1k {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8f06519-8e17-49ea-ac0c-4df29f548619_npgthk1k" returned: 0 in 0.413s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8f06519-8e17-49ea-ac0c-4df29f548619_npgthk1k {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8f06519-8e17-49ea-ac0c-4df29f548619_npgthk1k" returned: 1 in 0.492s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8f06519-8e17-49ea-ac0c-4df29f548619_npgthk1k' failed. Not Retrying. {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 11:54:25 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[742a9b03-77a8-428d-98b5-bdf224d1c623]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:54:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_t9sz7eybdevstack@QuobyteHD {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_t9sz7eybdevstack@QuobyteHD" returned: 0 in 0.489s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:25 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] d8f06519-8e17-49ea-ac0c-4df29f548619 was qcow2, converting to raw {{(pid=83176) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 18 11:54:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_t9sz7eybdevstack@QuobyteHD /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d27f096e-ab1f-49aa-84e9-f3c07530c0a8 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:25 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=112, name=volume-d27f096e-ab1f-49aa-84e9-f3c07530c0a8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:54:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_t9sz7eybdevstack@QuobyteHD /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d27f096e-ab1f-49aa-84e9-f3c07530c0a8" returned: 0 in 1.118s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:26 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_t9sz7eybdevstack@QuobyteHD, size 112.00 MB, duration 1.16 sec, destination /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d27f096e-ab1f-49aa-84e9-f3c07530c0a8 {{(pid=83176) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 11:54:26 devstack cinder-volume[83176]: INFO cinder.image.image_utils [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Converted 112.00 MB image at 96.41 MB/s
Sep 18 11:54:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d27f096e-ab1f-49aa-84e9-f3c07530c0a8 1G {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:27 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ab5f3f06-f314-4de1-afc4-61f920b77691 tempest-VolumesActionsTest-1897970757 None] Acquiring lock "cinder-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1" by "attach_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:54:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d27f096e-ab1f-49aa-84e9-f3c07530c0a8 1G" returned: 0 in 0.310s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:27 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ab5f3f06-f314-4de1-afc4-61f920b77691 tempest-VolumesActionsTest-1897970757 None] Lock "cinder-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1" acquired by "attach_volume" :: waited 0.137s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:54:27 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee79d37-aa85-4dcb-8ab4-602487910e3f]: (4, 'raw') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:54:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d27f096e-ab1f-49aa-84e9-f3c07530c0a8 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:27 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-ab5f3f06-f314-4de1-afc4-61f920b77691 tempest-VolumesActionsTest-1897970757 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:54:27 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-ab5f3f06-f314-4de1-afc4-61f920b77691 tempest-VolumesActionsTest-1897970757 None] Attaching volume 48dbf52d-c9a0-4777-bc2b-ea232f24fdb1 to instance 53d514db-97c9-406a-9be3-63facc6b69fd at mountpoint /dev/vdb on host None.
Sep 18 11:54:28 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-ab5f3f06-f314-4de1-afc4-61f920b77691 tempest-VolumesActionsTest-1897970757 None] Attach volume completed successfully.
Sep 18 11:54:28 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-ab5f3f06-f314-4de1-afc4-61f920b77691 tempest-VolumesActionsTest-1897970757 None] Lock "cinder-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1" released by "attach_volume" :: held 0.831s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:54:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d27f096e-ab1f-49aa-84e9-f3c07530c0a8" returned: 0 in 0.726s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d27f096e-ab1f-49aa-84e9-f3c07530c0a8 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:28 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-22a32deb-4421-4a88-be43-5a0aa9dc9489 tempest-VolumesActionsTest-1897970757 None] Acquiring lock "cinder-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1-detach_volume" by "detach_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:54:28 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-22a32deb-4421-4a88-be43-5a0aa9dc9489 tempest-VolumesActionsTest-1897970757 None] Lock "cinder-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1-detach_volume" acquired by "detach_volume" :: waited 0.095s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:54:28 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-22a32deb-4421-4a88-be43-5a0aa9dc9489 tempest-VolumesActionsTest-1897970757 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:54:28 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-22a32deb-4421-4a88-be43-5a0aa9dc9489 tempest-VolumesActionsTest-1897970757 None] Detaching volume 48dbf52d-c9a0-4777-bc2b-ea232f24fdb1 from instance 53d514db-97c9-406a-9be3-63facc6b69fd.
Sep 18 11:54:28 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-22a32deb-4421-4a88-be43-5a0aa9dc9489 tempest-VolumesActionsTest-1897970757 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:54:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d27f096e-ab1f-49aa-84e9-f3c07530c0a8" returned: 1 in 0.730s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d27f096e-ab1f-49aa-84e9-f3c07530c0a8' failed. Not Retrying. {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 11:54:28 devstack cinder-volume[83176]: DEBUG cinder.volume.volume_utils [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Downloaded image d8f06519-8e17-49ea-ac0c-4df29f548619 ((None, [{'url': 'file:///opt/stack/data/glance/images/d8f06519-8e17-49ea-ac0c-4df29f548619', 'metadata': {}}])) to volume d27f096e-ab1f-49aa-84e9-f3c07530c0a8 successfully. {{(pid=83176) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 18 11:54:28 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Temporary image d8f06519-8e17-49ea-ac0c-4df29f548619 for user 4e933a756f4849a88f9dde3096c9862e is deleted. {{(pid=83176) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 18 11:54:28 devstack cinder-volume[83176]: DEBUG cinder.volume.volume_utils [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Marking volume d27f096e-ab1f-49aa-84e9-f3c07530c0a8 as bootable. {{(pid=83176) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 18 11:54:28 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Copying metadata from image d8f06519-8e17-49ea-ac0c-4df29f548619 to d27f096e-ab1f-49aa-84e9-f3c07530c0a8. {{(pid=83176) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 18 11:54:28 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Creating volume glance metadata for volume d27f096e-ab1f-49aa-84e9-f3c07530c0a8 backed by image d8f06519-8e17-49ea-ac0c-4df29f548619 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd8f06519-8e17-49ea-ac0c-4df29f548619', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83176) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 18 11:54:29 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-22a32deb-4421-4a88-be43-5a0aa9dc9489 tempest-VolumesActionsTest-1897970757 None] Detach volume completed successfully.
Sep 18 11:54:29 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-22a32deb-4421-4a88-be43-5a0aa9dc9489 tempest-VolumesActionsTest-1897970757 None] Lock "cinder-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1-detach_volume" released by "detach_volume" :: held 0.398s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:54:29 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21c59f1b-dbed-49d7-905f-55c1fdbf06bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d27f096e-ab1f-49aa-84e9-f3c07530c0a8', 'volume_size': 1, 'image_id': 'd8f06519-8e17-49ea-ac0c-4df29f548619', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8f06519-8e17-49ea-ac0c-4df29f548619', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '68bc9b408b424a06a12482824dcdb45c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8f06519-8e17-49ea-ac0c-4df29f548619', 'created_at': datetime.datetime(2025, 9, 18, 9, 18, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 9, 18, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8f06519-8e17-49ea-ac0c-4df29f548619/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6ada286c80>}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:54:29 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (924e3de0-f75b-4d2e-ba5c-33c066adff8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:54:29 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Volume volume-d27f096e-ab1f-49aa-84e9-f3c07530c0a8 (d27f096e-ab1f-49aa-84e9-f3c07530c0a8): created successfully
Sep 18 11:54:29 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (924e3de0-f75b-4d2e-ba5c-33c066adff8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:54:29 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Flow 'volume_create_manager' (5f7e45a4-5ac0-45c2-a655-a65eab62fb6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:54:29 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-33e14e6d-90b7-4740-8b3f-9e750c3cb478 tempest-VolumesExtendTest-1650714599 None] Created volume successfully.
Sep 18 11:54:30 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-835c8845-70d8-423f-a2b9-77006f75f630 tempest-VolumesExtendTest-1650714599 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:54:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-835c8845-70d8-423f-a2b9-77006f75f630 tempest-VolumesExtendTest-1650714599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:54:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-835c8845-70d8-423f-a2b9-77006f75f630 tempest-VolumesExtendTest-1650714599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:54:30 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bad7939-b4dd-4a1c-ad98-67b0b7b397e3]: (4, 'raw') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:54:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-835c8845-70d8-423f-a2b9-77006f75f630 tempest-VolumesExtendTest-1650714599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d27f096e-ab1f-49aa-84e9-f3c07530c0a8 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-835c8845-70d8-423f-a2b9-77006f75f630 tempest-VolumesExtendTest-1650714599 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d27f096e-ab1f-49aa-84e9-f3c07530c0a8" returned: 0 in 0.783s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-835c8845-70d8-423f-a2b9-77006f75f630 tempest-VolumesExtendTest-1650714599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d27f096e-ab1f-49aa-84e9-f3c07530c0a8 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-835c8845-70d8-423f-a2b9-77006f75f630 tempest-VolumesExtendTest-1650714599 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d27f096e-ab1f-49aa-84e9-f3c07530c0a8" returned: 1 in 0.944s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-835c8845-70d8-423f-a2b9-77006f75f630 tempest-VolumesExtendTest-1650714599 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d27f096e-ab1f-49aa-84e9-f3c07530c0a8' failed. Not Retrying. {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 11:54:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-835c8845-70d8-423f-a2b9-77006f75f630 tempest-VolumesExtendTest-1650714599 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d27f096e-ab1f-49aa-84e9-f3c07530c0a8 2G {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-835c8845-70d8-423f-a2b9-77006f75f630 tempest-VolumesExtendTest-1650714599 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d27f096e-ab1f-49aa-84e9-f3c07530c0a8 2G" returned: 0 in 0.180s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-835c8845-70d8-423f-a2b9-77006f75f630 tempest-VolumesExtendTest-1650714599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.176s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:54:33 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-835c8845-70d8-423f-a2b9-77006f75f630 tempest-VolumesExtendTest-1650714599 None] Extend volume completed successfully.
Sep 18 11:54:34 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-7bca8252-c7fe-4905-8763-7fd32ba0157d tempest-VolumesExtendTest-1650714599 None] Acquiring lock "cinder-d27f096e-ab1f-49aa-84e9-f3c07530c0a8-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:54:34 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-7bca8252-c7fe-4905-8763-7fd32ba0157d tempest-VolumesExtendTest-1650714599 None] Lock "cinder-d27f096e-ab1f-49aa-84e9-f3c07530c0a8-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:54:34 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-7bca8252-c7fe-4905-8763-7fd32ba0157d tempest-VolumesExtendTest-1650714599 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:54:34 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-7bca8252-c7fe-4905-8763-7fd32ba0157d tempest-VolumesExtendTest-1650714599 None] Acquiring lock "cinder-quobyte-d27f096e-ab1f-49aa-84e9-f3c07530c0a8" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:54:34 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-7bca8252-c7fe-4905-8763-7fd32ba0157d tempest-VolumesExtendTest-1650714599 None] Lock "cinder-quobyte-d27f096e-ab1f-49aa-84e9-f3c07530c0a8" acquired by "delete_volume" :: waited 0.012s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:54:34 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c000d6-1cc9-42ef-9d4a-c8d35e2a0996]: (4, 'raw') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:54:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7bca8252-c7fe-4905-8763-7fd32ba0157d tempest-VolumesExtendTest-1650714599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d27f096e-ab1f-49aa-84e9-f3c07530c0a8 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7bca8252-c7fe-4905-8763-7fd32ba0157d tempest-VolumesExtendTest-1650714599 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d27f096e-ab1f-49aa-84e9-f3c07530c0a8" returned: 0 in 0.408s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7bca8252-c7fe-4905-8763-7fd32ba0157d tempest-VolumesExtendTest-1650714599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d27f096e-ab1f-49aa-84e9-f3c07530c0a8 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7bca8252-c7fe-4905-8763-7fd32ba0157d tempest-VolumesExtendTest-1650714599 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d27f096e-ab1f-49aa-84e9-f3c07530c0a8" returned: 1 in 0.367s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7bca8252-c7fe-4905-8763-7fd32ba0157d tempest-VolumesExtendTest-1650714599 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d27f096e-ab1f-49aa-84e9-f3c07530c0a8' failed. Not Retrying. {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 11:54:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7bca8252-c7fe-4905-8763-7fd32ba0157d tempest-VolumesExtendTest-1650714599 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d27f096e-ab1f-49aa-84e9-f3c07530c0a8 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7bca8252-c7fe-4905-8763-7fd32ba0157d tempest-VolumesExtendTest-1650714599 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d27f096e-ab1f-49aa-84e9-f3c07530c0a8" returned: 0 in 0.148s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:35 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-7bca8252-c7fe-4905-8763-7fd32ba0157d tempest-VolumesExtendTest-1650714599 None] Lock "cinder-quobyte-d27f096e-ab1f-49aa-84e9-f3c07530c0a8" released by "delete_volume" :: held 1.193s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:54:36 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-7bca8252-c7fe-4905-8763-7fd32ba0157d tempest-VolumesExtendTest-1650714599 None] Created reservations ['e74979ea-0b21-4928-87b1-c205a6e4697c', '374702b3-3c3c-4820-bbc0-8ba3b898bc4b', 'a84223a1-6eb4-49a8-ab50-fbb48f3596bd', 'ee426fcd-8b67-4df7-9349-81b9f4d5a980'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:54:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-7bca8252-c7fe-4905-8763-7fd32ba0157d tempest-VolumesExtendTest-1650714599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:54:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-7bca8252-c7fe-4905-8763-7fd32ba0157d tempest-VolumesExtendTest-1650714599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:54:36 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-7bca8252-c7fe-4905-8763-7fd32ba0157d tempest-VolumesExtendTest-1650714599 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:54:36 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-7bca8252-c7fe-4905-8763-7fd32ba0157d tempest-VolumesExtendTest-1650714599 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:54:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-7bca8252-c7fe-4905-8763-7fd32ba0157d tempest-VolumesExtendTest-1650714599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:54:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7bca8252-c7fe-4905-8763-7fd32ba0157d tempest-VolumesExtendTest-1650714599 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7bca8252-c7fe-4905-8763-7fd32ba0157d tempest-VolumesExtendTest-1650714599 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.111s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:36 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-7bca8252-c7fe-4905-8763-7fd32ba0157d tempest-VolumesExtendTest-1650714599 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:54:36 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-7bca8252-c7fe-4905-8763-7fd32ba0157d tempest-VolumesExtendTest-1650714599 None] Deleted volume successfully.
Sep 18 11:54:36 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-7bca8252-c7fe-4905-8763-7fd32ba0157d tempest-VolumesExtendTest-1650714599 None] Lock "cinder-d27f096e-ab1f-49aa-84e9-f3c07530c0a8-delete_volume" released by "delete_volume" :: held 2.286s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:54:37 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-13ad81ac-0b48-43ba-8ab6-f8be80b67547 tempest-VolumesExtendTest-1650714599 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:54:37 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-13ad81ac-0b48-43ba-8ab6-f8be80b67547 tempest-VolumesExtendTest-1650714599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:54:37 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-13ad81ac-0b48-43ba-8ab6-f8be80b67547 tempest-VolumesExtendTest-1650714599 None] Flow 'volume_create_manager' (89eb1966-9ffd-42f1-9ae4-29af040ae6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:54:37 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-13ad81ac-0b48-43ba-8ab6-f8be80b67547 tempest-VolumesExtendTest-1650714599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38caa87a-4fa4-4ab4-b940-3375bb0bb644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:54:37 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-13ad81ac-0b48-43ba-8ab6-f8be80b67547 tempest-VolumesExtendTest-1650714599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38caa87a-4fa4-4ab4-b940-3375bb0bb644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1131567011',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5ab5d24-45a3-4e77-b78e-f410466132d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434bf4d46ad84fe793129101815910b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:54:37Z,use_quota=True,user_id='4e933a756f4849a88f9dde3096c9862e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:54:37 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-13ad81ac-0b48-43ba-8ab6-f8be80b67547 tempest-VolumesExtendTest-1650714599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3874468b-8066-4463-afa5-3e61af55379a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:54:37 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-13ad81ac-0b48-43ba-8ab6-f8be80b67547 tempest-VolumesExtendTest-1650714599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3874468b-8066-4463-afa5-3e61af55379a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:54:37 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-13ad81ac-0b48-43ba-8ab6-f8be80b67547 tempest-VolumesExtendTest-1650714599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f754a427-d7ad-415d-82be-9d44a527bbc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:54:37 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-13ad81ac-0b48-43ba-8ab6-f8be80b67547 tempest-VolumesExtendTest-1650714599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f754a427-d7ad-415d-82be-9d44a527bbc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5ab5d24-45a3-4e77-b78e-f410466132d0', 'volume_name': 'volume-e5ab5d24-45a3-4e77-b78e-f410466132d0', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:54:37 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-13ad81ac-0b48-43ba-8ab6-f8be80b67547 tempest-VolumesExtendTest-1650714599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5d9265a-2884-43c6-83e0-81b784a1b947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:54:37 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-13ad81ac-0b48-43ba-8ab6-f8be80b67547 tempest-VolumesExtendTest-1650714599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5d9265a-2884-43c6-83e0-81b784a1b947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:54:37 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-13ad81ac-0b48-43ba-8ab6-f8be80b67547 tempest-VolumesExtendTest-1650714599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cecdec48-ed79-4ca3-90d9-bbf96bc2e096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:54:37 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-13ad81ac-0b48-43ba-8ab6-f8be80b67547 tempest-VolumesExtendTest-1650714599 None] Volume e5ab5d24-45a3-4e77-b78e-f410466132d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5ab5d24-45a3-4e77-b78e-f410466132d0', 'volume_size': 1}
Sep 18 11:54:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-13ad81ac-0b48-43ba-8ab6-f8be80b67547 tempest-VolumesExtendTest-1650714599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:54:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-13ad81ac-0b48-43ba-8ab6-f8be80b67547 tempest-VolumesExtendTest-1650714599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:54:37 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-13ad81ac-0b48-43ba-8ab6-f8be80b67547 tempest-VolumesExtendTest-1650714599 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1131567011',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5ab5d24-45a3-4e77-b78e-f410466132d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434bf4d46ad84fe793129101815910b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:54:37Z,use_quota=True,user_id='4e933a756f4849a88f9dde3096c9862e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:54:37 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-13ad81ac-0b48-43ba-8ab6-f8be80b67547 tempest-VolumesExtendTest-1650714599 None] Creating volume e5ab5d24-45a3-4e77-b78e-f410466132d0 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:54:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-13ad81ac-0b48-43ba-8ab6-f8be80b67547 tempest-VolumesExtendTest-1650714599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:54:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-13ad81ac-0b48-43ba-8ab6-f8be80b67547 tempest-VolumesExtendTest-1650714599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:54:37 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-13ad81ac-0b48-43ba-8ab6-f8be80b67547 tempest-VolumesExtendTest-1650714599 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:54:37 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-13ad81ac-0b48-43ba-8ab6-f8be80b67547 tempest-VolumesExtendTest-1650714599 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:54:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-13ad81ac-0b48-43ba-8ab6-f8be80b67547 tempest-VolumesExtendTest-1650714599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:54:37 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-13ad81ac-0b48-43ba-8ab6-f8be80b67547 tempest-VolumesExtendTest-1650714599 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:54:37 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-13ad81ac-0b48-43ba-8ab6-f8be80b67547 tempest-VolumesExtendTest-1650714599 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:54:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-13ad81ac-0b48-43ba-8ab6-f8be80b67547 tempest-VolumesExtendTest-1650714599 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5ab5d24-45a3-4e77-b78e-f410466132d0 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:37 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=113, name=volume-e5ab5d24-45a3-4e77-b78e-f410466132d0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:54:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-13ad81ac-0b48-43ba-8ab6-f8be80b67547 tempest-VolumesExtendTest-1650714599 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5ab5d24-45a3-4e77-b78e-f410466132d0 1073741824" returned: 0 in 0.342s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-13ad81ac-0b48-43ba-8ab6-f8be80b67547 tempest-VolumesExtendTest-1650714599 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5ab5d24-45a3-4e77-b78e-f410466132d0 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-13ad81ac-0b48-43ba-8ab6-f8be80b67547 tempest-VolumesExtendTest-1650714599 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5ab5d24-45a3-4e77-b78e-f410466132d0" returned: 0 in 0.095s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:38 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-13ad81ac-0b48-43ba-8ab6-f8be80b67547 tempest-VolumesExtendTest-1650714599 None] <== create_volume: return (553ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:54:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-13ad81ac-0b48-43ba-8ab6-f8be80b67547 tempest-VolumesExtendTest-1650714599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.565s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:54:38 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-13ad81ac-0b48-43ba-8ab6-f8be80b67547 tempest-VolumesExtendTest-1650714599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cecdec48-ed79-4ca3-90d9-bbf96bc2e096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5ab5d24-45a3-4e77-b78e-f410466132d0', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:54:38 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-13ad81ac-0b48-43ba-8ab6-f8be80b67547 tempest-VolumesExtendTest-1650714599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (610d3d77-c9f4-4ef2-83c8-baf8adacd63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:54:38 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-13ad81ac-0b48-43ba-8ab6-f8be80b67547 tempest-VolumesExtendTest-1650714599 None] Volume volume-e5ab5d24-45a3-4e77-b78e-f410466132d0 (e5ab5d24-45a3-4e77-b78e-f410466132d0): created successfully
Sep 18 11:54:38 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-13ad81ac-0b48-43ba-8ab6-f8be80b67547 tempest-VolumesExtendTest-1650714599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (610d3d77-c9f4-4ef2-83c8-baf8adacd63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:54:38 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-13ad81ac-0b48-43ba-8ab6-f8be80b67547 tempest-VolumesExtendTest-1650714599 None] Flow 'volume_create_manager' (89eb1966-9ffd-42f1-9ae4-29af040ae6df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:54:38 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-13ad81ac-0b48-43ba-8ab6-f8be80b67547 tempest-VolumesExtendTest-1650714599 None] Created volume successfully.
Sep 18 11:54:40 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-28134afc-deee-4223-8db1-908162ae66b2 tempest-VolumesExtendTest-1650714599 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:54:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-28134afc-deee-4223-8db1-908162ae66b2 tempest-VolumesExtendTest-1650714599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:54:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-28134afc-deee-4223-8db1-908162ae66b2 tempest-VolumesExtendTest-1650714599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:54:40 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-28134afc-deee-4223-8db1-908162ae66b2 tempest-VolumesExtendTest-1650714599 None] Creating offline snapshot dfda7ef1-73f7-4445-9d78-972e92a7cc38 of volume e5ab5d24-45a3-4e77-b78e-f410466132d0 {{(pid=83176) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 11:54:40 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e03cc8-87bc-48fb-8f8c-f8f0e4f384b0]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:54:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-28134afc-deee-4223-8db1-908162ae66b2 tempest-VolumesExtendTest-1650714599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5ab5d24-45a3-4e77-b78e-f410466132d0 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-28134afc-deee-4223-8db1-908162ae66b2 tempest-VolumesExtendTest-1650714599 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5ab5d24-45a3-4e77-b78e-f410466132d0" returned: 0 in 0.549s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-28134afc-deee-4223-8db1-908162ae66b2 tempest-VolumesExtendTest-1650714599 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5ab5d24-45a3-4e77-b78e-f410466132d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5ab5d24-45a3-4e77-b78e-f410466132d0.dfda7ef1-73f7-4445-9d78-972e92a7cc38 1G {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:40 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=114, name=volume-e5ab5d24-45a3-4e77-b78e-f410466132d0.dfda7ef1-73f7-4445-9d78-972e92a7cc38, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:54:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-28134afc-deee-4223-8db1-908162ae66b2 tempest-VolumesExtendTest-1650714599 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5ab5d24-45a3-4e77-b78e-f410466132d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5ab5d24-45a3-4e77-b78e-f410466132d0.dfda7ef1-73f7-4445-9d78-972e92a7cc38 1G" returned: 0 in 0.243s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-28134afc-deee-4223-8db1-908162ae66b2 tempest-VolumesExtendTest-1650714599 None] Running cmd (subprocess): qemu-img rebase -u -b volume-e5ab5d24-45a3-4e77-b78e-f410466132d0 -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5ab5d24-45a3-4e77-b78e-f410466132d0.dfda7ef1-73f7-4445-9d78-972e92a7cc38 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-28134afc-deee-4223-8db1-908162ae66b2 tempest-VolumesExtendTest-1650714599 None] CMD "qemu-img rebase -u -b volume-e5ab5d24-45a3-4e77-b78e-f410466132d0 -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5ab5d24-45a3-4e77-b78e-f410466132d0.dfda7ef1-73f7-4445-9d78-972e92a7cc38" returned: 0 in 0.122s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:41 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-28134afc-deee-4223-8db1-908162ae66b2 tempest-VolumesExtendTest-1650714599 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5ab5d24-45a3-4e77-b78e-f410466132d0.dfda7ef1-73f7-4445-9d78-972e92a7cc38 is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 11:54:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-28134afc-deee-4223-8db1-908162ae66b2 tempest-VolumesExtendTest-1650714599 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5ab5d24-45a3-4e77-b78e-f410466132d0.dfda7ef1-73f7-4445-9d78-972e92a7cc38 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-28134afc-deee-4223-8db1-908162ae66b2 tempest-VolumesExtendTest-1650714599 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5ab5d24-45a3-4e77-b78e-f410466132d0.dfda7ef1-73f7-4445-9d78-972e92a7cc38" returned: 0 in 0.103s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:41 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-28134afc-deee-4223-8db1-908162ae66b2 tempest-VolumesExtendTest-1650714599 None] Setting permissions: /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5ab5d24-45a3-4e77-b78e-f410466132d0 -> 1000:1000 {{(pid=83176) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 11:54:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-28134afc-deee-4223-8db1-908162ae66b2 tempest-VolumesExtendTest-1650714599 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5ab5d24-45a3-4e77-b78e-f410466132d0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5ab5d24-45a3-4e77-b78e-f410466132d0.dfda7ef1-73f7-4445-9d78-972e92a7cc38 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-28134afc-deee-4223-8db1-908162ae66b2 tempest-VolumesExtendTest-1650714599 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5ab5d24-45a3-4e77-b78e-f410466132d0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5ab5d24-45a3-4e77-b78e-f410466132d0.dfda7ef1-73f7-4445-9d78-972e92a7cc38" returned: 0 in 0.083s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-28134afc-deee-4223-8db1-908162ae66b2 tempest-VolumesExtendTest-1650714599 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5ab5d24-45a3-4e77-b78e-f410466132d0.info {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-28134afc-deee-4223-8db1-908162ae66b2 tempest-VolumesExtendTest-1650714599 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5ab5d24-45a3-4e77-b78e-f410466132d0.info" returned: 0 in 0.104s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:41 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-28134afc-deee-4223-8db1-908162ae66b2 tempest-VolumesExtendTest-1650714599 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5ab5d24-45a3-4e77-b78e-f410466132d0.info is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 11:54:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-28134afc-deee-4223-8db1-908162ae66b2 tempest-VolumesExtendTest-1650714599 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5ab5d24-45a3-4e77-b78e-f410466132d0.info {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-28134afc-deee-4223-8db1-908162ae66b2 tempest-VolumesExtendTest-1650714599 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5ab5d24-45a3-4e77-b78e-f410466132d0.info" returned: 0 in 0.114s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-28134afc-deee-4223-8db1-908162ae66b2 tempest-VolumesExtendTest-1650714599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.669s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:54:42 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-28134afc-deee-4223-8db1-908162ae66b2 tempest-VolumesExtendTest-1650714599 None] Create snapshot completed successfully
Sep 18 11:54:43 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-fc003b33-3f1e-457f-af9a-414fe5802da4 tempest-VolumesExtendTest-1650714599 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:54:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-fc003b33-3f1e-457f-af9a-414fe5802da4 tempest-VolumesExtendTest-1650714599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:54:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-fc003b33-3f1e-457f-af9a-414fe5802da4 tempest-VolumesExtendTest-1650714599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:54:43 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdedb1b0-4a7a-421a-99e6-abe7c0142c3f]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:54:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fc003b33-3f1e-457f-af9a-414fe5802da4 tempest-VolumesExtendTest-1650714599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5ab5d24-45a3-4e77-b78e-f410466132d0 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fc003b33-3f1e-457f-af9a-414fe5802da4 tempest-VolumesExtendTest-1650714599 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5ab5d24-45a3-4e77-b78e-f410466132d0" returned: 0 in 0.625s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fc003b33-3f1e-457f-af9a-414fe5802da4 tempest-VolumesExtendTest-1650714599 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5ab5d24-45a3-4e77-b78e-f410466132d0.dfda7ef1-73f7-4445-9d78-972e92a7cc38 2G {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fc003b33-3f1e-457f-af9a-414fe5802da4 tempest-VolumesExtendTest-1650714599 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5ab5d24-45a3-4e77-b78e-f410466132d0.dfda7ef1-73f7-4445-9d78-972e92a7cc38 2G" returned: 0 in 0.703s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-fc003b33-3f1e-457f-af9a-414fe5802da4 tempest-VolumesExtendTest-1650714599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.543s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:54:45 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-fc003b33-3f1e-457f-af9a-414fe5802da4 tempest-VolumesExtendTest-1650714599 None] Extend volume completed successfully.
Sep 18 11:54:46 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f057a285-7011-4b9a-88fb-402be4041422 tempest-VolumesExtendTest-1650714599 None] Acquiring lock "cinder-dfda7ef1-73f7-4445-9d78-972e92a7cc38-delete_snapshot" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:54:46 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f057a285-7011-4b9a-88fb-402be4041422 tempest-VolumesExtendTest-1650714599 None] Lock "cinder-dfda7ef1-73f7-4445-9d78-972e92a7cc38-delete_snapshot" acquired by "delete_snapshot" :: waited 0.126s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:54:46 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-f057a285-7011-4b9a-88fb-402be4041422 tempest-VolumesExtendTest-1650714599 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:54:46 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f057a285-7011-4b9a-88fb-402be4041422 tempest-VolumesExtendTest-1650714599 None] Acquiring lock "cinder-quobyte-e5ab5d24-45a3-4e77-b78e-f410466132d0" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:54:46 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f057a285-7011-4b9a-88fb-402be4041422 tempest-VolumesExtendTest-1650714599 None] Lock "cinder-quobyte-e5ab5d24-45a3-4e77-b78e-f410466132d0" acquired by "delete_snapshot" :: waited 0.027s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:54:46 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f057a285-7011-4b9a-88fb-402be4041422 tempest-VolumesExtendTest-1650714599 None] Acquiring lock "cinder-quobyte-dfda7ef1-73f7-4445-9d78-972e92a7cc38" by "_delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:54:46 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f057a285-7011-4b9a-88fb-402be4041422 tempest-VolumesExtendTest-1650714599 None] Lock "cinder-quobyte-dfda7ef1-73f7-4445-9d78-972e92a7cc38" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:54:46 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-f057a285-7011-4b9a-88fb-402be4041422 tempest-VolumesExtendTest-1650714599 None] Deleting offline snapshot dfda7ef1-73f7-4445-9d78-972e92a7cc38 of volume e5ab5d24-45a3-4e77-b78e-f410466132d0 {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 11:54:46 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-f057a285-7011-4b9a-88fb-402be4041422 tempest-VolumesExtendTest-1650714599 None] snapshot_file for this snap is: volume-e5ab5d24-45a3-4e77-b78e-f410466132d0.dfda7ef1-73f7-4445-9d78-972e92a7cc38 {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 11:54:46 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fb2e86-a22d-45bf-8094-636cf1db996e]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:54:46 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f057a285-7011-4b9a-88fb-402be4041422 tempest-VolumesExtendTest-1650714599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5ab5d24-45a3-4e77-b78e-f410466132d0.dfda7ef1-73f7-4445-9d78-972e92a7cc38 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f057a285-7011-4b9a-88fb-402be4041422 tempest-VolumesExtendTest-1650714599 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5ab5d24-45a3-4e77-b78e-f410466132d0.dfda7ef1-73f7-4445-9d78-972e92a7cc38" returned: 0 in 0.631s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:47 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-f057a285-7011-4b9a-88fb-402be4041422 tempest-VolumesExtendTest-1650714599 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5ab5d24-45a3-4e77-b78e-f410466132d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 11:54:47 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[145566df-e591-4a96-be6b-377837a5f26d]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:54:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f057a285-7011-4b9a-88fb-402be4041422 tempest-VolumesExtendTest-1650714599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5ab5d24-45a3-4e77-b78e-f410466132d0 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f057a285-7011-4b9a-88fb-402be4041422 tempest-VolumesExtendTest-1650714599 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5ab5d24-45a3-4e77-b78e-f410466132d0" returned: 0 in 0.745s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:48 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f057a285-7011-4b9a-88fb-402be4041422 tempest-VolumesExtendTest-1650714599 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5ab5d24-45a3-4e77-b78e-f410466132d0.dfda7ef1-73f7-4445-9d78-972e92a7cc38 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:48 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f057a285-7011-4b9a-88fb-402be4041422 tempest-VolumesExtendTest-1650714599 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5ab5d24-45a3-4e77-b78e-f410466132d0.dfda7ef1-73f7-4445-9d78-972e92a7cc38" returned: 0 in 0.604s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:48 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f057a285-7011-4b9a-88fb-402be4041422 tempest-VolumesExtendTest-1650714599 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5ab5d24-45a3-4e77-b78e-f410466132d0.dfda7ef1-73f7-4445-9d78-972e92a7cc38 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:48 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f057a285-7011-4b9a-88fb-402be4041422 tempest-VolumesExtendTest-1650714599 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5ab5d24-45a3-4e77-b78e-f410466132d0.dfda7ef1-73f7-4445-9d78-972e92a7cc38" returned: 0 in 0.153s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:48 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f057a285-7011-4b9a-88fb-402be4041422 tempest-VolumesExtendTest-1650714599 None] Lock "cinder-quobyte-dfda7ef1-73f7-4445-9d78-972e92a7cc38" released by "_delete_snapshot" :: held 2.666s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:54:48 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f057a285-7011-4b9a-88fb-402be4041422 tempest-VolumesExtendTest-1650714599 None] Lock "cinder-quobyte-e5ab5d24-45a3-4e77-b78e-f410466132d0" released by "delete_snapshot" :: held 2.702s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:54:49 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-f057a285-7011-4b9a-88fb-402be4041422 tempest-VolumesExtendTest-1650714599 None] Created reservations ['eaa3dfe9-f1fb-4356-a279-abb52fd341cc', '4639630c-d134-44cb-803c-8e6b3b91aa76', 'e5d8abe4-86a5-477a-bfca-d8cd5432affa', 'f3523836-235b-4e98-941f-8a4841e4d028'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:54:49 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-f057a285-7011-4b9a-88fb-402be4041422 tempest-VolumesExtendTest-1650714599 None] Delete snapshot completed successfully.
Sep 18 11:54:49 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f057a285-7011-4b9a-88fb-402be4041422 tempest-VolumesExtendTest-1650714599 None] Lock "cinder-dfda7ef1-73f7-4445-9d78-972e92a7cc38-delete_snapshot" released by "delete_snapshot" :: held 3.644s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:54:50 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-40ed1cb7-b28a-443a-b87d-17658e4f551c tempest-VolumesExtendTest-1650714599 None] Acquiring lock "cinder-e5ab5d24-45a3-4e77-b78e-f410466132d0-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:54:50 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-40ed1cb7-b28a-443a-b87d-17658e4f551c tempest-VolumesExtendTest-1650714599 None] Lock "cinder-e5ab5d24-45a3-4e77-b78e-f410466132d0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:54:51 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-40ed1cb7-b28a-443a-b87d-17658e4f551c tempest-VolumesExtendTest-1650714599 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:54:51 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-40ed1cb7-b28a-443a-b87d-17658e4f551c tempest-VolumesExtendTest-1650714599 None] Acquiring lock "cinder-quobyte-e5ab5d24-45a3-4e77-b78e-f410466132d0" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:54:51 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-40ed1cb7-b28a-443a-b87d-17658e4f551c tempest-VolumesExtendTest-1650714599 None] Lock "cinder-quobyte-e5ab5d24-45a3-4e77-b78e-f410466132d0" acquired by "delete_volume" :: waited 0.013s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:54:51 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[deec8896-fb60-498e-ab8e-49ccbf0d9fa5]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:54:51 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-40ed1cb7-b28a-443a-b87d-17658e4f551c tempest-VolumesExtendTest-1650714599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5ab5d24-45a3-4e77-b78e-f410466132d0 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:51 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-40ed1cb7-b28a-443a-b87d-17658e4f551c tempest-VolumesExtendTest-1650714599 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5ab5d24-45a3-4e77-b78e-f410466132d0" returned: 0 in 0.477s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:51 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-40ed1cb7-b28a-443a-b87d-17658e4f551c tempest-VolumesExtendTest-1650714599 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5ab5d24-45a3-4e77-b78e-f410466132d0 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:51 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-40ed1cb7-b28a-443a-b87d-17658e4f551c tempest-VolumesExtendTest-1650714599 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5ab5d24-45a3-4e77-b78e-f410466132d0" returned: 0 in 0.096s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:51 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-40ed1cb7-b28a-443a-b87d-17658e4f551c tempest-VolumesExtendTest-1650714599 None] Lock "cinder-quobyte-e5ab5d24-45a3-4e77-b78e-f410466132d0" released by "delete_volume" :: held 0.739s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:54:52 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-40ed1cb7-b28a-443a-b87d-17658e4f551c tempest-VolumesExtendTest-1650714599 None] Created reservations ['f88315ea-7053-4a24-9e3d-49627d7d9049', 'ece4b1dd-da36-4890-bb1c-9f1a77eeb4ae', '6a99fa8c-e4d3-4f77-a2af-715ba8fcb5be', 'f5f08a79-4ef3-419c-935e-4a29a20b991f'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:54:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-40ed1cb7-b28a-443a-b87d-17658e4f551c tempest-VolumesExtendTest-1650714599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:54:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-40ed1cb7-b28a-443a-b87d-17658e4f551c tempest-VolumesExtendTest-1650714599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:54:52 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-40ed1cb7-b28a-443a-b87d-17658e4f551c tempest-VolumesExtendTest-1650714599 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:54:52 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-40ed1cb7-b28a-443a-b87d-17658e4f551c tempest-VolumesExtendTest-1650714599 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:54:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-40ed1cb7-b28a-443a-b87d-17658e4f551c tempest-VolumesExtendTest-1650714599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:54:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-40ed1cb7-b28a-443a-b87d-17658e4f551c tempest-VolumesExtendTest-1650714599 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-40ed1cb7-b28a-443a-b87d-17658e4f551c tempest-VolumesExtendTest-1650714599 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.095s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:52 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-40ed1cb7-b28a-443a-b87d-17658e4f551c tempest-VolumesExtendTest-1650714599 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:54:52 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-40ed1cb7-b28a-443a-b87d-17658e4f551c tempest-VolumesExtendTest-1650714599 None] Deleted volume successfully.
Sep 18 11:54:52 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-40ed1cb7-b28a-443a-b87d-17658e4f551c tempest-VolumesExtendTest-1650714599 None] Lock "cinder-e5ab5d24-45a3-4e77-b78e-f410466132d0-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:54:57 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-b3f599b7-b928-40c2-99db-d5cf66cc084d tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:54:57 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3f599b7-b928-40c2-99db-d5cf66cc084d tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:54:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b3f599b7-b928-40c2-99db-d5cf66cc084d tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Flow 'volume_create_manager' (55f65b65-4581-4ffe-ab2a-cb1dbe2b30aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:54:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b3f599b7-b928-40c2-99db-d5cf66cc084d tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca4afc61-c45c-4526-aa74-23d56cf2e3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:54:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b3f599b7-b928-40c2-99db-d5cf66cc084d tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca4afc61-c45c-4526-aa74-23d56cf2e3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-504067514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e72dbd14-82b6-4a61-b534-5db02c0e9ad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bebc7602d73b45f8bc46ec46abcdc2dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:54:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:54:57Z,use_quota=True,user_id='2441bf982b804911b149efcec87ababc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:54:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b3f599b7-b928-40c2-99db-d5cf66cc084d tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b23d86a9-2157-4ffa-9ad5-189040b3f4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:54:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b3f599b7-b928-40c2-99db-d5cf66cc084d tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b23d86a9-2157-4ffa-9ad5-189040b3f4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:54:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b3f599b7-b928-40c2-99db-d5cf66cc084d tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cab9947c-a382-4539-ab7b-9255ba773707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:54:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b3f599b7-b928-40c2-99db-d5cf66cc084d tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cab9947c-a382-4539-ab7b-9255ba773707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e72dbd14-82b6-4a61-b534-5db02c0e9ad3', 'volume_name': 'volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3', 'volume_size': 2}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:54:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b3f599b7-b928-40c2-99db-d5cf66cc084d tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc3ce469-044d-4e23-beca-20ca1d147127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:54:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b3f599b7-b928-40c2-99db-d5cf66cc084d tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc3ce469-044d-4e23-beca-20ca1d147127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:54:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b3f599b7-b928-40c2-99db-d5cf66cc084d tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b14775-63bb-4104-b23f-7bdac0a3c7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:54:57 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-b3f599b7-b928-40c2-99db-d5cf66cc084d tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Volume e72dbd14-82b6-4a61-b534-5db02c0e9ad3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3', 'volume_size': 2}
Sep 18 11:54:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-b3f599b7-b928-40c2-99db-d5cf66cc084d tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:54:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-b3f599b7-b928-40c2-99db-d5cf66cc084d tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:54:57 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-b3f599b7-b928-40c2-99db-d5cf66cc084d tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-504067514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e72dbd14-82b6-4a61-b534-5db02c0e9ad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bebc7602d73b45f8bc46ec46abcdc2dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:54:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:54:57Z,use_quota=True,user_id='2441bf982b804911b149efcec87ababc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:54:57 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-b3f599b7-b928-40c2-99db-d5cf66cc084d tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Creating volume e72dbd14-82b6-4a61-b534-5db02c0e9ad3 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:54:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-b3f599b7-b928-40c2-99db-d5cf66cc084d tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:54:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-b3f599b7-b928-40c2-99db-d5cf66cc084d tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:54:57 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-b3f599b7-b928-40c2-99db-d5cf66cc084d tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:54:57 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-b3f599b7-b928-40c2-99db-d5cf66cc084d tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:54:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-b3f599b7-b928-40c2-99db-d5cf66cc084d tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:54:57 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-b3f599b7-b928-40c2-99db-d5cf66cc084d tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:54:57 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-b3f599b7-b928-40c2-99db-d5cf66cc084d tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:54:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b3f599b7-b928-40c2-99db-d5cf66cc084d tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3 2147483648 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:58 devstack quobyte-client[83193]: System call of process 95356 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:54:58 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=116, name=volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:54:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b3f599b7-b928-40c2-99db-d5cf66cc084d tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3 2147483648" returned: 0 in 1.454s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b3f599b7-b928-40c2-99db-d5cf66cc084d tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:54:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b3f599b7-b928-40c2-99db-d5cf66cc084d tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3" returned: 0 in 0.159s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:54:59 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-b3f599b7-b928-40c2-99db-d5cf66cc084d tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] <== create_volume: return (1750ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:54:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-b3f599b7-b928-40c2-99db-d5cf66cc084d tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.774s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:54:59 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b3f599b7-b928-40c2-99db-d5cf66cc084d tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b14775-63bb-4104-b23f-7bdac0a3c7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3', 'volume_size': 2}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:54:59 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b3f599b7-b928-40c2-99db-d5cf66cc084d tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (798adfc0-841d-48c8-b03e-1abf8082c1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:54:59 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-b3f599b7-b928-40c2-99db-d5cf66cc084d tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Volume volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3 (e72dbd14-82b6-4a61-b534-5db02c0e9ad3): created successfully
Sep 18 11:54:59 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b3f599b7-b928-40c2-99db-d5cf66cc084d tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (798adfc0-841d-48c8-b03e-1abf8082c1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:54:59 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b3f599b7-b928-40c2-99db-d5cf66cc084d tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Flow 'volume_create_manager' (55f65b65-4581-4ffe-ab2a-cb1dbe2b30aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:55:00 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-b3f599b7-b928-40c2-99db-d5cf66cc084d tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Created volume successfully.
Sep 18 11:55:01 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-a875f574-cb5d-4ace-9a16-4a7f0d27d4ac tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:55:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a875f574-cb5d-4ace-9a16-4a7f0d27d4ac tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:55:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a875f574-cb5d-4ace-9a16-4a7f0d27d4ac tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:55:01 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-a875f574-cb5d-4ace-9a16-4a7f0d27d4ac tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Creating offline snapshot be6a4b04-5e95-4f77-bd4a-5a26fb095326 of volume e72dbd14-82b6-4a61-b534-5db02c0e9ad3 {{(pid=83176) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 11:55:01 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afc042a-51d2-4377-bdaa-dba648321005]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:55:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a875f574-cb5d-4ace-9a16-4a7f0d27d4ac tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:55:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a875f574-cb5d-4ace-9a16-4a7f0d27d4ac tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3" returned: 0 in 0.470s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:55:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a875f574-cb5d-4ace-9a16-4a7f0d27d4ac tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3.be6a4b04-5e95-4f77-bd4a-5a26fb095326 2G {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:55:02 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=117, name=volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3.be6a4b04-5e95-4f77-bd4a-5a26fb095326, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:55:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a875f574-cb5d-4ace-9a16-4a7f0d27d4ac tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3.be6a4b04-5e95-4f77-bd4a-5a26fb095326 2G" returned: 0 in 0.322s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:55:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a875f574-cb5d-4ace-9a16-4a7f0d27d4ac tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Running cmd (subprocess): qemu-img rebase -u -b volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3 -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3.be6a4b04-5e95-4f77-bd4a-5a26fb095326 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:55:02 devstack quobyte-client[83193]: System call of process 95415 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:55:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a875f574-cb5d-4ace-9a16-4a7f0d27d4ac tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] CMD "qemu-img rebase -u -b volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3 -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3.be6a4b04-5e95-4f77-bd4a-5a26fb095326" returned: 0 in 0.241s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:55:02 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-a875f574-cb5d-4ace-9a16-4a7f0d27d4ac tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3.be6a4b04-5e95-4f77-bd4a-5a26fb095326 is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 11:55:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a875f574-cb5d-4ace-9a16-4a7f0d27d4ac tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3.be6a4b04-5e95-4f77-bd4a-5a26fb095326 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:55:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a875f574-cb5d-4ace-9a16-4a7f0d27d4ac tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3.be6a4b04-5e95-4f77-bd4a-5a26fb095326" returned: 0 in 0.097s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:55:02 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-a875f574-cb5d-4ace-9a16-4a7f0d27d4ac tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Setting permissions: /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3 -> 1000:1000 {{(pid=83176) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 11:55:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a875f574-cb5d-4ace-9a16-4a7f0d27d4ac tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3.be6a4b04-5e95-4f77-bd4a-5a26fb095326 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:55:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a875f574-cb5d-4ace-9a16-4a7f0d27d4ac tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3.be6a4b04-5e95-4f77-bd4a-5a26fb095326" returned: 0 in 0.112s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:55:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a875f574-cb5d-4ace-9a16-4a7f0d27d4ac tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3.info {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:55:03 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a875f574-cb5d-4ace-9a16-4a7f0d27d4ac tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3.info" returned: 0 in 0.102s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:55:03 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-a875f574-cb5d-4ace-9a16-4a7f0d27d4ac tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3.info is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 11:55:03 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a875f574-cb5d-4ace-9a16-4a7f0d27d4ac tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3.info {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:55:03 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a875f574-cb5d-4ace-9a16-4a7f0d27d4ac tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3.info" returned: 0 in 0.097s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:55:03 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a875f574-cb5d-4ace-9a16-4a7f0d27d4ac tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.894s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:55:03 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-a875f574-cb5d-4ace-9a16-4a7f0d27d4ac tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Create snapshot completed successfully
Sep 18 11:55:04 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-3f2df5f0-2d68-4b18-beb0-ba1fb810e4d6 tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Acquiring lock "cinder-be6a4b04-5e95-4f77-bd4a-5a26fb095326-delete_snapshot" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:55:04 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-3f2df5f0-2d68-4b18-beb0-ba1fb810e4d6 tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Lock "cinder-be6a4b04-5e95-4f77-bd4a-5a26fb095326-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:55:04 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-3f2df5f0-2d68-4b18-beb0-ba1fb810e4d6 tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:55:04 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-3f2df5f0-2d68-4b18-beb0-ba1fb810e4d6 tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Acquiring lock "cinder-quobyte-e72dbd14-82b6-4a61-b534-5db02c0e9ad3" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:55:04 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-3f2df5f0-2d68-4b18-beb0-ba1fb810e4d6 tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Lock "cinder-quobyte-e72dbd14-82b6-4a61-b534-5db02c0e9ad3" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:55:04 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-3f2df5f0-2d68-4b18-beb0-ba1fb810e4d6 tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Acquiring lock "cinder-quobyte-be6a4b04-5e95-4f77-bd4a-5a26fb095326" by "_delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:55:04 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-3f2df5f0-2d68-4b18-beb0-ba1fb810e4d6 tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Lock "cinder-quobyte-be6a4b04-5e95-4f77-bd4a-5a26fb095326" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:55:04 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-3f2df5f0-2d68-4b18-beb0-ba1fb810e4d6 tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Deleting offline snapshot be6a4b04-5e95-4f77-bd4a-5a26fb095326 of volume e72dbd14-82b6-4a61-b534-5db02c0e9ad3 {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 11:55:04 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-3f2df5f0-2d68-4b18-beb0-ba1fb810e4d6 tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] snapshot_file for this snap is: volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3.be6a4b04-5e95-4f77-bd4a-5a26fb095326 {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 11:55:04 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e155d73e-4024-4fa1-8564-174b3b6427cb]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:55:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-3f2df5f0-2d68-4b18-beb0-ba1fb810e4d6 tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3.be6a4b04-5e95-4f77-bd4a-5a26fb095326 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:55:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-3f2df5f0-2d68-4b18-beb0-ba1fb810e4d6 tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3.be6a4b04-5e95-4f77-bd4a-5a26fb095326" returned: 0 in 0.480s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:55:05 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-3f2df5f0-2d68-4b18-beb0-ba1fb810e4d6 tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 11:55:05 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53e291a-dc6c-4535-8776-a92c739580c0]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:55:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-3f2df5f0-2d68-4b18-beb0-ba1fb810e4d6 tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:55:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-3f2df5f0-2d68-4b18-beb0-ba1fb810e4d6 tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3" returned: 0 in 0.521s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:55:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-3f2df5f0-2d68-4b18-beb0-ba1fb810e4d6 tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3.be6a4b04-5e95-4f77-bd4a-5a26fb095326 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:55:06 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-3f2df5f0-2d68-4b18-beb0-ba1fb810e4d6 tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3.be6a4b04-5e95-4f77-bd4a-5a26fb095326" returned: 0 in 0.220s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:55:06 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-3f2df5f0-2d68-4b18-beb0-ba1fb810e4d6 tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3.be6a4b04-5e95-4f77-bd4a-5a26fb095326 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:55:06 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-3f2df5f0-2d68-4b18-beb0-ba1fb810e4d6 tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3.be6a4b04-5e95-4f77-bd4a-5a26fb095326" returned: 0 in 0.086s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:55:06 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-3f2df5f0-2d68-4b18-beb0-ba1fb810e4d6 tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Lock "cinder-quobyte-be6a4b04-5e95-4f77-bd4a-5a26fb095326" released by "_delete_snapshot" :: held 1.663s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:55:06 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-3f2df5f0-2d68-4b18-beb0-ba1fb810e4d6 tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Lock "cinder-quobyte-e72dbd14-82b6-4a61-b534-5db02c0e9ad3" released by "delete_snapshot" :: held 1.696s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:55:06 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-2db36a11-1483-4fdf-9088-86bf5e145977 tempest-VolumesActionsTest-1897970757 None] Acquiring lock "cinder-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1" by "attach_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:55:06 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-3f2df5f0-2d68-4b18-beb0-ba1fb810e4d6 tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Created reservations ['bd73e53d-b403-4bdb-8020-e03ec46691b4', 'f6642a30-a16c-494b-b3fb-36033121c71b', '02ee854a-7a04-414e-b35d-e2c08d8ee7df', '431bcca5-bab2-44ee-b359-902dfa1d3f4e'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:55:06 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-2db36a11-1483-4fdf-9088-86bf5e145977 tempest-VolumesActionsTest-1897970757 None] Lock "cinder-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1" acquired by "attach_volume" :: waited 0.055s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:55:06 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-2db36a11-1483-4fdf-9088-86bf5e145977 tempest-VolumesActionsTest-1897970757 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:55:06 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-2db36a11-1483-4fdf-9088-86bf5e145977 tempest-VolumesActionsTest-1897970757 None] Attaching volume 48dbf52d-c9a0-4777-bc2b-ea232f24fdb1 to instance e691a001-6228-4056-b853-3571dbc7fdb7 at mountpoint /dev/vdb on host None.
Sep 18 11:55:06 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-3f2df5f0-2d68-4b18-beb0-ba1fb810e4d6 tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Delete snapshot completed successfully.
Sep 18 11:55:06 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-3f2df5f0-2d68-4b18-beb0-ba1fb810e4d6 tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Lock "cinder-be6a4b04-5e95-4f77-bd4a-5a26fb095326-delete_snapshot" released by "delete_snapshot" :: held 2.431s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:55:06 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-2db36a11-1483-4fdf-9088-86bf5e145977 tempest-VolumesActionsTest-1897970757 None] Attach volume completed successfully.
Sep 18 11:55:06 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-2db36a11-1483-4fdf-9088-86bf5e145977 tempest-VolumesActionsTest-1897970757 None] Lock "cinder-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1" released by "attach_volume" :: held 0.176s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:55:07 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-a97c63f0-a1a8-4f7e-8fd3-ea76da3fc6e1 tempest-VolumesActionsTest-1897970757 None] Acquiring lock "cinder-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1-detach_volume" by "detach_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:55:07 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-a97c63f0-a1a8-4f7e-8fd3-ea76da3fc6e1 tempest-VolumesActionsTest-1897970757 None] Lock "cinder-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:55:07 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-a97c63f0-a1a8-4f7e-8fd3-ea76da3fc6e1 tempest-VolumesActionsTest-1897970757 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:55:07 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-a97c63f0-a1a8-4f7e-8fd3-ea76da3fc6e1 tempest-VolumesActionsTest-1897970757 None] Detaching volume 48dbf52d-c9a0-4777-bc2b-ea232f24fdb1 from instance e691a001-6228-4056-b853-3571dbc7fdb7.
Sep 18 11:55:07 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-a97c63f0-a1a8-4f7e-8fd3-ea76da3fc6e1 tempest-VolumesActionsTest-1897970757 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:55:07 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-a97c63f0-a1a8-4f7e-8fd3-ea76da3fc6e1 tempest-VolumesActionsTest-1897970757 None] Detach volume completed successfully.
Sep 18 11:55:07 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-a97c63f0-a1a8-4f7e-8fd3-ea76da3fc6e1 tempest-VolumesActionsTest-1897970757 None] Lock "cinder-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1-detach_volume" released by "detach_volume" :: held 0.105s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:55:07 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-8f5750d4-4523-4ee7-a668-d31c07f903a5 tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Acquiring lock "cinder-e72dbd14-82b6-4a61-b534-5db02c0e9ad3-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:55:07 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-8f5750d4-4523-4ee7-a668-d31c07f903a5 tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Lock "cinder-e72dbd14-82b6-4a61-b534-5db02c0e9ad3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:55:07 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-8f5750d4-4523-4ee7-a668-d31c07f903a5 tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:55:07 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-8f5750d4-4523-4ee7-a668-d31c07f903a5 tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Acquiring lock "cinder-quobyte-e72dbd14-82b6-4a61-b534-5db02c0e9ad3" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:55:07 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-8f5750d4-4523-4ee7-a668-d31c07f903a5 tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Lock "cinder-quobyte-e72dbd14-82b6-4a61-b534-5db02c0e9ad3" acquired by "delete_volume" :: waited 0.016s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:55:07 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6516955-1410-4074-940b-abd96a6aefdf]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:55:07 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8f5750d4-4523-4ee7-a668-d31c07f903a5 tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:55:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8f5750d4-4523-4ee7-a668-d31c07f903a5 tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3" returned: 0 in 0.546s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:55:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8f5750d4-4523-4ee7-a668-d31c07f903a5 tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:55:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8f5750d4-4523-4ee7-a668-d31c07f903a5 tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e72dbd14-82b6-4a61-b534-5db02c0e9ad3" returned: 0 in 0.140s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:55:08 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-8f5750d4-4523-4ee7-a668-d31c07f903a5 tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Lock "cinder-quobyte-e72dbd14-82b6-4a61-b534-5db02c0e9ad3" released by "delete_volume" :: held 0.967s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:55:09 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-8f5750d4-4523-4ee7-a668-d31c07f903a5 tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Created reservations ['0c38341e-5e29-4900-8b20-3a51f8e9002d', 'f0aa099f-c444-4b6f-b17c-b2b81d4651fb', '28eef321-63c5-4b1e-8ba1-785d6567ffca', 'd9835ed0-19bb-4db4-980d-a83b1a9a3491'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:55:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-8f5750d4-4523-4ee7-a668-d31c07f903a5 tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:55:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-8f5750d4-4523-4ee7-a668-d31c07f903a5 tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:55:09 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-8f5750d4-4523-4ee7-a668-d31c07f903a5 tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:55:09 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-8f5750d4-4523-4ee7-a668-d31c07f903a5 tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:55:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-8f5750d4-4523-4ee7-a668-d31c07f903a5 tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:55:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8f5750d4-4523-4ee7-a668-d31c07f903a5 tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:55:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8f5750d4-4523-4ee7-a668-d31c07f903a5 tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.127s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:55:09 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-8f5750d4-4523-4ee7-a668-d31c07f903a5 tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:55:09 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-8f5750d4-4523-4ee7-a668-d31c07f903a5 tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Deleted volume successfully.
Sep 18 11:55:11 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-8f5750d4-4523-4ee7-a668-d31c07f903a5 tempest-VolumesSnapshotNegativeTestJSON-1106029843 None] Lock "cinder-e72dbd14-82b6-4a61-b534-5db02c0e9ad3-delete_volume" released by "delete_volume" :: held 3.558s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:55:13 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 11:55:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:55:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:55:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:55:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:55:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:55:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:55:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.122s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:55:14 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:55:19 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=56,cinder:INSERT=16,cinder:UPDATE=49,cinder:DELETE=4 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:55:19 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=52,cinder:UPDATE=62,cinder:INSERT=21,cinder:DELETE=4 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:55:19 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-2b7a0e05-08f6-4ff6-adfe-65032724655e tempest-VolumesActionsTest-1897970757 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:55:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-2b7a0e05-08f6-4ff6-adfe-65032724655e tempest-VolumesActionsTest-1897970757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:55:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-2b7a0e05-08f6-4ff6-adfe-65032724655e tempest-VolumesActionsTest-1897970757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:55:19 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fce4335-502e-4490-aa37-569183788eb6]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:55:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2b7a0e05-08f6-4ff6-adfe-65032724655e tempest-VolumesActionsTest-1897970757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:55:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2b7a0e05-08f6-4ff6-adfe-65032724655e tempest-VolumesActionsTest-1897970757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1" returned: 0 in 0.466s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:55:19 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6debe768-8a4d-4896-9809-0eb3bc8e52d0]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:55:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2b7a0e05-08f6-4ff6-adfe-65032724655e tempest-VolumesActionsTest-1897970757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:55:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2b7a0e05-08f6-4ff6-adfe-65032724655e tempest-VolumesActionsTest-1897970757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1" returned: 0 in 0.509s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:55:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2b7a0e05-08f6-4ff6-adfe-65032724655e tempest-VolumesActionsTest-1897970757 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1 /opt/stack/data/cinder/conversion/48dbf52d-c9a0-4777-bc2b-ea232f24fdb1.temp_image.3774ecad-03c9-4aec-ae19-446aa7f06051jtv7p0_w.img {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:55:20 devstack quobyte-client[83193]: System call of process 95717 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:55:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2b7a0e05-08f6-4ff6-adfe-65032724655e tempest-VolumesActionsTest-1897970757 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1 /opt/stack/data/cinder/conversion/48dbf52d-c9a0-4777-bc2b-ea232f24fdb1.temp_image.3774ecad-03c9-4aec-ae19-446aa7f06051jtv7p0_w.img" returned: 0 in 6.207s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:55:26 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[de16e99b-2b34-4a3b-be51-890b91f78a78]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:55:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2b7a0e05-08f6-4ff6-adfe-65032724655e tempest-VolumesActionsTest-1897970757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:55:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2b7a0e05-08f6-4ff6-adfe-65032724655e tempest-VolumesActionsTest-1897970757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1" returned: 0 in 0.654s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:55:27 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-2b7a0e05-08f6-4ff6-adfe-65032724655e tempest-VolumesActionsTest-1897970757 None] Image conversion details: src /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1, size 1024.00 MB, duration 6.23 sec, destination /opt/stack/data/cinder/conversion/48dbf52d-c9a0-4777-bc2b-ea232f24fdb1.temp_image.3774ecad-03c9-4aec-ae19-446aa7f06051jtv7p0_w.img {{(pid=83176) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 11:55:27 devstack cinder-volume[83176]: INFO cinder.image.image_utils [None req-2b7a0e05-08f6-4ff6-adfe-65032724655e tempest-VolumesActionsTest-1897970757 None] Converted 1024.00 MB image at 164.43 MB/s
Sep 18 11:55:27 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-2b7a0e05-08f6-4ff6-adfe-65032724655e tempest-VolumesActionsTest-1897970757 None] 3774ecad-03c9-4aec-ae19-446aa7f06051 was raw, no need to convert to raw {{(pid=83176) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1127}}
Sep 18 11:55:37 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=2 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:55:54 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-c1b7b528-753b-4cb1-b16b-10770f6c81ef tempest-TestInstancesWithCinderVolumes-262508111 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:55:54 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1b7b528-753b-4cb1-b16b-10770f6c81ef tempest-TestInstancesWithCinderVolumes-262508111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:55:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c1b7b528-753b-4cb1-b16b-10770f6c81ef tempest-TestInstancesWithCinderVolumes-262508111 None] Flow 'volume_create_manager' (083068a9-39e1-47aa-a148-f582eb77ce50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:55:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c1b7b528-753b-4cb1-b16b-10770f6c81ef tempest-TestInstancesWithCinderVolumes-262508111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d31fa27-61d5-4dbc-88da-c4c9a8c0c5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:55:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c1b7b528-753b-4cb1-b16b-10770f6c81ef tempest-TestInstancesWithCinderVolumes-262508111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d31fa27-61d5-4dbc-88da-c4c9a8c0c5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-434707855',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52703dec-d446-4b87-8760-6973ab489700,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6c2df1694834ab9bf9346f7f582ca4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:55:55Z,use_quota=True,user_id='b20cf71a9e5d452f8dc11dcaac7e5cd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d40404ab-1e97-47cb-8b72-e66348ea1b61),volume_type_id=d40404ab-1e97-47cb-8b72-e66348ea1b61)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:55:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c1b7b528-753b-4cb1-b16b-10770f6c81ef tempest-TestInstancesWithCinderVolumes-262508111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbbfb395-e220-4e62-9aa1-ee7191f01dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:55:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c1b7b528-753b-4cb1-b16b-10770f6c81ef tempest-TestInstancesWithCinderVolumes-262508111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbbfb395-e220-4e62-9aa1-ee7191f01dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:55:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c1b7b528-753b-4cb1-b16b-10770f6c81ef tempest-TestInstancesWithCinderVolumes-262508111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f9d1488-39b9-4d8b-abfb-823d8b8051ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:55:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c1b7b528-753b-4cb1-b16b-10770f6c81ef tempest-TestInstancesWithCinderVolumes-262508111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f9d1488-39b9-4d8b-abfb-823d8b8051ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52703dec-d446-4b87-8760-6973ab489700', 'volume_name': 'volume-52703dec-d446-4b87-8760-6973ab489700', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:55:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c1b7b528-753b-4cb1-b16b-10770f6c81ef tempest-TestInstancesWithCinderVolumes-262508111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38ed5db8-3c2c-4e78-a8c8-c27a7ca81a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:55:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c1b7b528-753b-4cb1-b16b-10770f6c81ef tempest-TestInstancesWithCinderVolumes-262508111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38ed5db8-3c2c-4e78-a8c8-c27a7ca81a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:55:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c1b7b528-753b-4cb1-b16b-10770f6c81ef tempest-TestInstancesWithCinderVolumes-262508111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (523f7c21-f0cb-44a5-b248-67df5f0c6e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:55:55 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-c1b7b528-753b-4cb1-b16b-10770f6c81ef tempest-TestInstancesWithCinderVolumes-262508111 None] Volume 52703dec-d446-4b87-8760-6973ab489700: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52703dec-d446-4b87-8760-6973ab489700', 'volume_size': 1}
Sep 18 11:55:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-c1b7b528-753b-4cb1-b16b-10770f6c81ef tempest-TestInstancesWithCinderVolumes-262508111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:55:55 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-f3c255b5-6cfb-4eda-9cd3-98a3aaca773d tempest-TestInstancesWithCinderVolumes-262508111 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:55:55 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3c255b5-6cfb-4eda-9cd3-98a3aaca773d tempest-TestInstancesWithCinderVolumes-262508111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:55:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f3c255b5-6cfb-4eda-9cd3-98a3aaca773d tempest-TestInstancesWithCinderVolumes-262508111 None] Flow 'volume_create_manager' (75c72812-2a03-4f3d-94ae-de9336cfd9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:55:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f3c255b5-6cfb-4eda-9cd3-98a3aaca773d tempest-TestInstancesWithCinderVolumes-262508111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d6da255-0c66-47da-97e0-654d831da87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:55:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f3c255b5-6cfb-4eda-9cd3-98a3aaca773d tempest-TestInstancesWithCinderVolumes-262508111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d6da255-0c66-47da-97e0-654d831da87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-789485226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beb0c09b-b7a1-4cfd-bcd4-08f26884bd2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6c2df1694834ab9bf9346f7f582ca4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:55:55Z,use_quota=True,user_id='b20cf71a9e5d452f8dc11dcaac7e5cd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93f6bccd-a28f-4f29-960a-3cfe4d1f2703),volume_type_id=93f6bccd-a28f-4f29-960a-3cfe4d1f2703)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:55:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f3c255b5-6cfb-4eda-9cd3-98a3aaca773d tempest-TestInstancesWithCinderVolumes-262508111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf94cf0a-8acc-4032-add7-c987fc8bb7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:55:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f3c255b5-6cfb-4eda-9cd3-98a3aaca773d tempest-TestInstancesWithCinderVolumes-262508111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf94cf0a-8acc-4032-add7-c987fc8bb7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:55:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f3c255b5-6cfb-4eda-9cd3-98a3aaca773d tempest-TestInstancesWithCinderVolumes-262508111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf64d532-ff86-4b1d-b154-adfad26c041c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:55:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f3c255b5-6cfb-4eda-9cd3-98a3aaca773d tempest-TestInstancesWithCinderVolumes-262508111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf64d532-ff86-4b1d-b154-adfad26c041c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beb0c09b-b7a1-4cfd-bcd4-08f26884bd2a', 'volume_name': 'volume-beb0c09b-b7a1-4cfd-bcd4-08f26884bd2a', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:55:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f3c255b5-6cfb-4eda-9cd3-98a3aaca773d tempest-TestInstancesWithCinderVolumes-262508111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d278f4bc-cd1c-457b-9638-66e1b9feb810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:55:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f3c255b5-6cfb-4eda-9cd3-98a3aaca773d tempest-TestInstancesWithCinderVolumes-262508111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d278f4bc-cd1c-457b-9638-66e1b9feb810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:55:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f3c255b5-6cfb-4eda-9cd3-98a3aaca773d tempest-TestInstancesWithCinderVolumes-262508111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5034e30a-b1e2-4ed6-8878-fbf4b9c977f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:55:55 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-f3c255b5-6cfb-4eda-9cd3-98a3aaca773d tempest-TestInstancesWithCinderVolumes-262508111 None] Volume beb0c09b-b7a1-4cfd-bcd4-08f26884bd2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beb0c09b-b7a1-4cfd-bcd4-08f26884bd2a', 'volume_size': 1}
Sep 18 11:55:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f3c255b5-6cfb-4eda-9cd3-98a3aaca773d tempest-TestInstancesWithCinderVolumes-262508111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:55:56 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:55:56 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:55:56 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Flow 'volume_create_manager' (1f7d4081-5f6a-4b5a-a3f5-6baaff6dae57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:55:56 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eec3ee2-317b-4616-9923-7642b497a01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:55:56 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eec3ee2-317b-4616-9923-7642b497a01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:55:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-238271532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae74cbdf-8629-41fc-b1ac-3a3c24db2401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6c2df1694834ab9bf9346f7f582ca4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:55:56Z,use_quota=True,user_id='b20cf71a9e5d452f8dc11dcaac7e5cd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8493c0e-c26c-43ba-8d24-41a7481ea684),volume_type_id=f8493c0e-c26c-43ba-8d24-41a7481ea684)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:55:56 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3101f510-fbb7-4ecd-bc49-1c874e87ee7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:55:56 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3101f510-fbb7-4ecd-bc49-1c874e87ee7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:55:56 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ca9e3b0-5806-4a13-aea0-35a4edf058e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:55:56 devstack cinder-volume[83176]: DEBUG cinder.image.glance [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Creating Keystone auth plugin from conf {{(pid=83176) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 18 11:55:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ca9e3b0-5806-4a13-aea0-35a4edf058e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ae74cbdf-8629-41fc-b1ac-3a3c24db2401', 'volume_name': 'volume-ae74cbdf-8629-41fc-b1ac-3a3c24db2401', 'volume_size': 1, 'image_id': '1e9e896b-8534-41b3-879a-18e0fc5ab1df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e9e896b-8534-41b3-879a-18e0fc5ab1df', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1285306202', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c6c2df1694834ab9bf9346f7f582ca4c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1e9e896b-8534-41b3-879a-18e0fc5ab1df', 'created_at': datetime.datetime(2025, 9, 18, 9, 55, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 9, 55, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e9e896b-8534-41b3-879a-18e0fc5ab1df/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6ae49c3310>}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:55:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cafedc83-5cd8-4d32-8620-f736bc3d2608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:55:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cafedc83-5cd8-4d32-8620-f736bc3d2608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:55:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6307d164-048d-44c8-9e45-a4a723e980a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:55:57 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Volume ae74cbdf-8629-41fc-b1ac-3a3c24db2401: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ae74cbdf-8629-41fc-b1ac-3a3c24db2401', 'volume_size': 1, 'image_id': '1e9e896b-8534-41b3-879a-18e0fc5ab1df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e9e896b-8534-41b3-879a-18e0fc5ab1df', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1285306202', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c6c2df1694834ab9bf9346f7f582ca4c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1e9e896b-8534-41b3-879a-18e0fc5ab1df', 'created_at': datetime.datetime(2025, 9, 18, 9, 55, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 9, 55, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e9e896b-8534-41b3-879a-18e0fc5ab1df/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6ae49c3310>}
Sep 18 11:55:57 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Cloning ae74cbdf-8629-41fc-b1ac-3a3c24db2401 from image 1e9e896b-8534-41b3-879a-18e0fc5ab1df  at location (None, [{'url': 'file:///opt/stack/data/glance/images/1e9e896b-8534-41b3-879a-18e0fc5ab1df', 'metadata': {}}]). {{(pid=83176) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 18 11:56:06 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:56:06 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:56:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-2b7a0e05-08f6-4ff6-adfe-65032724655e tempest-VolumesActionsTest-1897970757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 49.983s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:56:09 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-2b7a0e05-08f6-4ff6-adfe-65032724655e tempest-VolumesActionsTest-1897970757 None] Uploaded volume to glance image-id: 3774ecad-03c9-4aec-ae19-446aa7f06051. {{(pid=83176) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Sep 18 11:56:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-c1b7b528-753b-4cb1-b16b-10770f6c81ef tempest-TestInstancesWithCinderVolumes-262508111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.191s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:56:09 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-c1b7b528-753b-4cb1-b16b-10770f6c81ef tempest-TestInstancesWithCinderVolumes-262508111 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-434707855',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52703dec-d446-4b87-8760-6973ab489700,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6c2df1694834ab9bf9346f7f582ca4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:55:55Z,use_quota=True,user_id='b20cf71a9e5d452f8dc11dcaac7e5cd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d40404ab-1e97-47cb-8b72-e66348ea1b61),volume_type_id=d40404ab-1e97-47cb-8b72-e66348ea1b61)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:56:09 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-c1b7b528-753b-4cb1-b16b-10770f6c81ef tempest-TestInstancesWithCinderVolumes-262508111 None] Creating volume 52703dec-d446-4b87-8760-6973ab489700 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:56:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-c1b7b528-753b-4cb1-b16b-10770f6c81ef tempest-TestInstancesWithCinderVolumes-262508111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:56:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-c1b7b528-753b-4cb1-b16b-10770f6c81ef tempest-TestInstancesWithCinderVolumes-262508111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:56:09 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-c1b7b528-753b-4cb1-b16b-10770f6c81ef tempest-TestInstancesWithCinderVolumes-262508111 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:56:09 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-c1b7b528-753b-4cb1-b16b-10770f6c81ef tempest-TestInstancesWithCinderVolumes-262508111 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:56:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-c1b7b528-753b-4cb1-b16b-10770f6c81ef tempest-TestInstancesWithCinderVolumes-262508111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:56:09 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-c1b7b528-753b-4cb1-b16b-10770f6c81ef tempest-TestInstancesWithCinderVolumes-262508111 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:56:09 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-c1b7b528-753b-4cb1-b16b-10770f6c81ef tempest-TestInstancesWithCinderVolumes-262508111 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:56:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c1b7b528-753b-4cb1-b16b-10770f6c81ef tempest-TestInstancesWithCinderVolumes-262508111 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-52703dec-d446-4b87-8760-6973ab489700 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:56:09 devstack quobyte-client[83193]: System call of process 95783 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:56:09 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=119, name=volume-52703dec-d446-4b87-8760-6973ab489700, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:56:09 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-2b7a0e05-08f6-4ff6-adfe-65032724655e tempest-VolumesActionsTest-1897970757 None] Copy volume to image completed successfully.
Sep 18 11:56:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c1b7b528-753b-4cb1-b16b-10770f6c81ef tempest-TestInstancesWithCinderVolumes-262508111 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-52703dec-d446-4b87-8760-6973ab489700 1073741824" returned: 0 in 0.465s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:56:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c1b7b528-753b-4cb1-b16b-10770f6c81ef tempest-TestInstancesWithCinderVolumes-262508111 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-52703dec-d446-4b87-8760-6973ab489700 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:56:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c1b7b528-753b-4cb1-b16b-10770f6c81ef tempest-TestInstancesWithCinderVolumes-262508111 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-52703dec-d446-4b87-8760-6973ab489700" returned: 0 in 0.096s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:56:09 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-c1b7b528-753b-4cb1-b16b-10770f6c81ef tempest-TestInstancesWithCinderVolumes-262508111 None] <== create_volume: return (602ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:56:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-c1b7b528-753b-4cb1-b16b-10770f6c81ef tempest-TestInstancesWithCinderVolumes-262508111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.614s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:56:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f3c255b5-6cfb-4eda-9cd3-98a3aaca773d tempest-TestInstancesWithCinderVolumes-262508111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.630s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:56:10 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f3c255b5-6cfb-4eda-9cd3-98a3aaca773d tempest-TestInstancesWithCinderVolumes-262508111 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-789485226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beb0c09b-b7a1-4cfd-bcd4-08f26884bd2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6c2df1694834ab9bf9346f7f582ca4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:55:55Z,use_quota=True,user_id='b20cf71a9e5d452f8dc11dcaac7e5cd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93f6bccd-a28f-4f29-960a-3cfe4d1f2703),volume_type_id=93f6bccd-a28f-4f29-960a-3cfe4d1f2703)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:56:10 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-f3c255b5-6cfb-4eda-9cd3-98a3aaca773d tempest-TestInstancesWithCinderVolumes-262508111 None] Creating volume beb0c09b-b7a1-4cfd-bcd4-08f26884bd2a {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:56:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f3c255b5-6cfb-4eda-9cd3-98a3aaca773d tempest-TestInstancesWithCinderVolumes-262508111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:56:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f3c255b5-6cfb-4eda-9cd3-98a3aaca773d tempest-TestInstancesWithCinderVolumes-262508111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:56:10 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f3c255b5-6cfb-4eda-9cd3-98a3aaca773d tempest-TestInstancesWithCinderVolumes-262508111 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:56:10 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f3c255b5-6cfb-4eda-9cd3-98a3aaca773d tempest-TestInstancesWithCinderVolumes-262508111 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:56:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f3c255b5-6cfb-4eda-9cd3-98a3aaca773d tempest-TestInstancesWithCinderVolumes-262508111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:56:10 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f3c255b5-6cfb-4eda-9cd3-98a3aaca773d tempest-TestInstancesWithCinderVolumes-262508111 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:56:10 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-f3c255b5-6cfb-4eda-9cd3-98a3aaca773d tempest-TestInstancesWithCinderVolumes-262508111 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:56:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f3c255b5-6cfb-4eda-9cd3-98a3aaca773d tempest-TestInstancesWithCinderVolumes-262508111 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-beb0c09b-b7a1-4cfd-bcd4-08f26884bd2a 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:56:10 devstack quobyte-client[83193]: System call of process 95787 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:56:10 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=120, name=volume-beb0c09b-b7a1-4cfd-bcd4-08f26884bd2a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:56:10 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c1b7b528-753b-4cb1-b16b-10770f6c81ef tempest-TestInstancesWithCinderVolumes-262508111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (523f7c21-f0cb-44a5-b248-67df5f0c6e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52703dec-d446-4b87-8760-6973ab489700', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:56:10 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c1b7b528-753b-4cb1-b16b-10770f6c81ef tempest-TestInstancesWithCinderVolumes-262508111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a636dfd7-8907-48ba-a5e6-077adbac633f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:56:10 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-c1b7b528-753b-4cb1-b16b-10770f6c81ef tempest-TestInstancesWithCinderVolumes-262508111 None] Volume volume-52703dec-d446-4b87-8760-6973ab489700 (52703dec-d446-4b87-8760-6973ab489700): created successfully
Sep 18 11:56:10 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c1b7b528-753b-4cb1-b16b-10770f6c81ef tempest-TestInstancesWithCinderVolumes-262508111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a636dfd7-8907-48ba-a5e6-077adbac633f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:56:10 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c1b7b528-753b-4cb1-b16b-10770f6c81ef tempest-TestInstancesWithCinderVolumes-262508111 None] Flow 'volume_create_manager' (083068a9-39e1-47aa-a148-f582eb77ce50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:56:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f3c255b5-6cfb-4eda-9cd3-98a3aaca773d tempest-TestInstancesWithCinderVolumes-262508111 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-beb0c09b-b7a1-4cfd-bcd4-08f26884bd2a 1073741824" returned: 0 in 0.407s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:56:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f3c255b5-6cfb-4eda-9cd3-98a3aaca773d tempest-TestInstancesWithCinderVolumes-262508111 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-beb0c09b-b7a1-4cfd-bcd4-08f26884bd2a {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:56:10 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-c1b7b528-753b-4cb1-b16b-10770f6c81ef tempest-TestInstancesWithCinderVolumes-262508111 None] Created volume successfully.
Sep 18 11:56:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f3c255b5-6cfb-4eda-9cd3-98a3aaca773d tempest-TestInstancesWithCinderVolumes-262508111 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-beb0c09b-b7a1-4cfd-bcd4-08f26884bd2a" returned: 0 in 0.237s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:56:10 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f3c255b5-6cfb-4eda-9cd3-98a3aaca773d tempest-TestInstancesWithCinderVolumes-262508111 None] <== create_volume: return (692ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:56:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f3c255b5-6cfb-4eda-9cd3-98a3aaca773d tempest-TestInstancesWithCinderVolumes-262508111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:56:10 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f3c255b5-6cfb-4eda-9cd3-98a3aaca773d tempest-TestInstancesWithCinderVolumes-262508111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5034e30a-b1e2-4ed6-8878-fbf4b9c977f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beb0c09b-b7a1-4cfd-bcd4-08f26884bd2a', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:56:10 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f3c255b5-6cfb-4eda-9cd3-98a3aaca773d tempest-TestInstancesWithCinderVolumes-262508111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0849421c-ccd3-4857-99b7-4067305d7d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:56:11 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-f3c255b5-6cfb-4eda-9cd3-98a3aaca773d tempest-TestInstancesWithCinderVolumes-262508111 None] Volume volume-beb0c09b-b7a1-4cfd-bcd4-08f26884bd2a (beb0c09b-b7a1-4cfd-bcd4-08f26884bd2a): created successfully
Sep 18 11:56:11 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f3c255b5-6cfb-4eda-9cd3-98a3aaca773d tempest-TestInstancesWithCinderVolumes-262508111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0849421c-ccd3-4857-99b7-4067305d7d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:56:11 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f3c255b5-6cfb-4eda-9cd3-98a3aaca773d tempest-TestInstancesWithCinderVolumes-262508111 None] Flow 'volume_create_manager' (75c72812-2a03-4f3d-94ae-de9336cfd9b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:56:11 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-f3c255b5-6cfb-4eda-9cd3-98a3aaca773d tempest-TestInstancesWithCinderVolumes-262508111 None] Created volume successfully.
Sep 18 11:56:11 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1e9e896b-8534-41b3-879a-18e0fc5ab1df_sx1sj_41devstack@QuobyteHD, size 20.69 MB, duration 14.26 sec {{(pid=83176) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 18 11:56:11 devstack cinder-volume[83176]: INFO cinder.image.image_utils [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Image download 20.69 MB at 1.45 MB/s
Sep 18 11:56:11 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[262e59b3-b069-422d-bb7f-3fb56c23bca3]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:56:11 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e9e896b-8534-41b3-879a-18e0fc5ab1df_sx1sj_41devstack@QuobyteHD {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:56:12 devstack sudo[95791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e9e896b-8534-41b3-879a-18e0fc5ab1df_sx1sj_41devstack@QuobyteHD
Sep 18 11:56:12 devstack sudo[95791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:56:12 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-c5dffe2b-1562-4659-a138-11e7c58f9fe4 tempest-VolumesActionsTest-1897970757 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:56:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-c5dffe2b-1562-4659-a138-11e7c58f9fe4 tempest-VolumesActionsTest-1897970757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:56:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-c5dffe2b-1562-4659-a138-11e7c58f9fe4 tempest-VolumesActionsTest-1897970757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:56:12 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3473454f-0fbc-4a1d-8624-8a7424f28eda]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:56:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c5dffe2b-1562-4659-a138-11e7c58f9fe4 tempest-VolumesActionsTest-1897970757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:56:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c5dffe2b-1562-4659-a138-11e7c58f9fe4 tempest-VolumesActionsTest-1897970757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1" returned: 0 in 0.476s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:56:12 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2373df-f847-4c8a-974c-1d21cd51c145]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:56:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c5dffe2b-1562-4659-a138-11e7c58f9fe4 tempest-VolumesActionsTest-1897970757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:56:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c5dffe2b-1562-4659-a138-11e7c58f9fe4 tempest-VolumesActionsTest-1897970757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1" returned: 0 in 0.462s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:56:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c5dffe2b-1562-4659-a138-11e7c58f9fe4 tempest-VolumesActionsTest-1897970757 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1 /opt/stack/data/cinder/conversion/48dbf52d-c9a0-4777-bc2b-ea232f24fdb1.temp_image.937aae85-1e18-4178-8c0c-3a3a316a54eazojvowss.img {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:56:14 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 11:56:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:56:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.023s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:56:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:56:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:56:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.064s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:56:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:56:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.781s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:56:15 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:56:15 devstack sudo[95791]: pam_unix(sudo:session): session closed for user root
Sep 18 11:56:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e9e896b-8534-41b3-879a-18e0fc5ab1df_sx1sj_41devstack@QuobyteHD" returned: 0 in 3.774s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:56:15 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Temporary image 1e9e896b-8534-41b3-879a-18e0fc5ab1df is fetched for user b20cf71a9e5d452f8dc11dcaac7e5cd9. {{(pid=83176) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 18 11:56:16 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8131451c-445c-48a2-bf73-67574da8d5f4]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:56:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e9e896b-8534-41b3-879a-18e0fc5ab1df_sx1sj_41devstack@QuobyteHD {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:56:18 devstack sudo[95814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e9e896b-8534-41b3-879a-18e0fc5ab1df_sx1sj_41devstack@QuobyteHD
Sep 18 11:56:18 devstack sudo[95814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 11:56:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c5dffe2b-1562-4659-a138-11e7c58f9fe4 tempest-VolumesActionsTest-1897970757 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1 /opt/stack/data/cinder/conversion/48dbf52d-c9a0-4777-bc2b-ea232f24fdb1.temp_image.937aae85-1e18-4178-8c0c-3a3a316a54eazojvowss.img" returned: 0 in 6.337s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:56:19 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb27b68-1d70-46ef-93c8-80f12e33c847]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:56:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c5dffe2b-1562-4659-a138-11e7c58f9fe4 tempest-VolumesActionsTest-1897970757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:56:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c5dffe2b-1562-4659-a138-11e7c58f9fe4 tempest-VolumesActionsTest-1897970757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1" returned: 0 in 0.674s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:56:20 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-c5dffe2b-1562-4659-a138-11e7c58f9fe4 tempest-VolumesActionsTest-1897970757 None] Image conversion details: src /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1, size 1024.00 MB, duration 6.36 sec, destination /opt/stack/data/cinder/conversion/48dbf52d-c9a0-4777-bc2b-ea232f24fdb1.temp_image.937aae85-1e18-4178-8c0c-3a3a316a54eazojvowss.img {{(pid=83176) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 11:56:20 devstack cinder-volume[83176]: INFO cinder.image.image_utils [None req-c5dffe2b-1562-4659-a138-11e7c58f9fe4 tempest-VolumesActionsTest-1897970757 None] Converted 1024.00 MB image at 160.89 MB/s
Sep 18 11:56:20 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-c5dffe2b-1562-4659-a138-11e7c58f9fe4 tempest-VolumesActionsTest-1897970757 None] 937aae85-1e18-4178-8c0c-3a3a316a54ea was raw, converting to qcow2 {{(pid=83176) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1144}}
Sep 18 11:56:20 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[955b5582-a559-40ab-a7bf-4da468bcbd24]: (4, 'raw') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:56:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c5dffe2b-1562-4659-a138-11e7c58f9fe4 tempest-VolumesActionsTest-1897970757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/48dbf52d-c9a0-4777-bc2b-ea232f24fdb1.temp_image.937aae85-1e18-4178-8c0c-3a3a316a54eazojvowss.img {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:56:20 devstack sudo[95814]: pam_unix(sudo:session): session closed for user root
Sep 18 11:56:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e9e896b-8534-41b3-879a-18e0fc5ab1df_sx1sj_41devstack@QuobyteHD" returned: 0 in 4.405s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:56:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:56:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c5dffe2b-1562-4659-a138-11e7c58f9fe4 tempest-VolumesActionsTest-1897970757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/48dbf52d-c9a0-4777-bc2b-ea232f24fdb1.temp_image.937aae85-1e18-4178-8c0c-3a3a316a54eazojvowss.img" returned: 0 in 0.458s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:56:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c5dffe2b-1562-4659-a138-11e7c58f9fe4 tempest-VolumesActionsTest-1897970757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/48dbf52d-c9a0-4777-bc2b-ea232f24fdb1.temp_image.937aae85-1e18-4178-8c0c-3a3a316a54eazojvowss.img {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:56:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c5dffe2b-1562-4659-a138-11e7c58f9fe4 tempest-VolumesActionsTest-1897970757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/48dbf52d-c9a0-4777-bc2b-ea232f24fdb1.temp_image.937aae85-1e18-4178-8c0c-3a3a316a54eazojvowss.img" returned: 1 in 0.359s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:56:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c5dffe2b-1562-4659-a138-11e7c58f9fe4 tempest-VolumesActionsTest-1897970757 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/48dbf52d-c9a0-4777-bc2b-ea232f24fdb1.temp_image.937aae85-1e18-4178-8c0c-3a3a316a54eazojvowss.img' failed. Not Retrying. {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 11:56:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c5dffe2b-1562-4659-a138-11e7c58f9fe4 tempest-VolumesActionsTest-1897970757 None] Running cmd (subprocess): qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/48dbf52d-c9a0-4777-bc2b-ea232f24fdb1.temp_image.937aae85-1e18-4178-8c0c-3a3a316a54eazojvowss.img /opt/stack/data/cinder/conversion/vol_upload_0h2jhpq1 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:56:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c5dffe2b-1562-4659-a138-11e7c58f9fe4 tempest-VolumesActionsTest-1897970757 None] CMD "qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/48dbf52d-c9a0-4777-bc2b-ea232f24fdb1.temp_image.937aae85-1e18-4178-8c0c-3a3a316a54eazojvowss.img /opt/stack/data/cinder/conversion/vol_upload_0h2jhpq1" returned: 0 in 0.166s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:56:21 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-c5dffe2b-1562-4659-a138-11e7c58f9fe4 tempest-VolumesActionsTest-1897970757 None] Image conversion details: src /opt/stack/data/cinder/conversion/48dbf52d-c9a0-4777-bc2b-ea232f24fdb1.temp_image.937aae85-1e18-4178-8c0c-3a3a316a54eazojvowss.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_0h2jhpq1 {{(pid=83176) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 11:56:21 devstack cinder-volume[83176]: INFO cinder.image.image_utils [None req-c5dffe2b-1562-4659-a138-11e7c58f9fe4 tempest-VolumesActionsTest-1897970757 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 18 11:56:21 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0db27c-95e6-4378-a046-0d7dd3909532]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:56:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c5dffe2b-1562-4659-a138-11e7c58f9fe4 tempest-VolumesActionsTest-1897970757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_0h2jhpq1 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:56:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c5dffe2b-1562-4659-a138-11e7c58f9fe4 tempest-VolumesActionsTest-1897970757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_0h2jhpq1" returned: 0 in 0.355s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:56:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-c5dffe2b-1562-4659-a138-11e7c58f9fe4 tempest-VolumesActionsTest-1897970757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.226s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:56:23 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-c5dffe2b-1562-4659-a138-11e7c58f9fe4 tempest-VolumesActionsTest-1897970757 None] Uploaded volume to glance image-id: 937aae85-1e18-4178-8c0c-3a3a316a54ea. {{(pid=83176) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Sep 18 11:56:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.607s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:56:23 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:55:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-238271532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae74cbdf-8629-41fc-b1ac-3a3c24db2401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6c2df1694834ab9bf9346f7f582ca4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:55:56Z,use_quota=True,user_id='b20cf71a9e5d452f8dc11dcaac7e5cd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8493c0e-c26c-43ba-8d24-41a7481ea684),volume_type_id=f8493c0e-c26c-43ba-8d24-41a7481ea684)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:56:23 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Creating volume ae74cbdf-8629-41fc-b1ac-3a3c24db2401 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:56:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:56:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:56:23 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:56:23 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:56:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:56:23 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:56:23 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:56:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-ae74cbdf-8629-41fc-b1ac-3a3c24db2401 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:56:23 devstack quobyte-client[83193]: System call of process 95835 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:56:23 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=121, name=volume-ae74cbdf-8629-41fc-b1ac-3a3c24db2401, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:56:23 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-c5dffe2b-1562-4659-a138-11e7c58f9fe4 tempest-VolumesActionsTest-1897970757 None] Copy volume to image completed successfully.
Sep 18 11:56:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-ae74cbdf-8629-41fc-b1ac-3a3c24db2401 1073741824" returned: 0 in 0.399s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:56:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-ae74cbdf-8629-41fc-b1ac-3a3c24db2401 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:56:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-ae74cbdf-8629-41fc-b1ac-3a3c24db2401" returned: 0 in 0.099s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:56:24 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] <== create_volume: return (555ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:56:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.578s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:56:24 devstack cinder-volume[83176]: DEBUG cinder.volume.volume_utils [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Attempting download of 1e9e896b-8534-41b3-879a-18e0fc5ab1df ((None, [{'url': 'file:///opt/stack/data/glance/images/1e9e896b-8534-41b3-879a-18e0fc5ab1df', 'metadata': {}}])) to volume ae74cbdf-8629-41fc-b1ac-3a3c24db2401. {{(pid=83176) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 18 11:56:24 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16ef4c5-d932-4c73-b4a9-5ebb94927e92]: (4, 'raw') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:56:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1e9e896b-8534-41b3-879a-18e0fc5ab1df_rehdlihl {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:56:25 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-933fad38-2417-473f-91bd-3d6f106cb2ec tempest-VolumesActionsTest-1897970757 None] Acquiring lock "cinder-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:56:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1e9e896b-8534-41b3-879a-18e0fc5ab1df_rehdlihl" returned: 0 in 0.593s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:56:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e9e896b-8534-41b3-879a-18e0fc5ab1df_rehdlihl {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:56:25 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-933fad38-2417-473f-91bd-3d6f106cb2ec tempest-VolumesActionsTest-1897970757 None] Lock "cinder-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1-delete_volume" acquired by "delete_volume" :: waited 0.181s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:56:25 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-933fad38-2417-473f-91bd-3d6f106cb2ec tempest-VolumesActionsTest-1897970757 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:56:25 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-933fad38-2417-473f-91bd-3d6f106cb2ec tempest-VolumesActionsTest-1897970757 None] Acquiring lock "cinder-quobyte-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:56:25 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-933fad38-2417-473f-91bd-3d6f106cb2ec tempest-VolumesActionsTest-1897970757 None] Lock "cinder-quobyte-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1" acquired by "delete_volume" :: waited 0.028s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:56:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e9e896b-8534-41b3-879a-18e0fc5ab1df_rehdlihl" returned: 1 in 0.497s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:56:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e9e896b-8534-41b3-879a-18e0fc5ab1df_rehdlihl' failed. Not Retrying. {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 11:56:25 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[51750f7c-ce15-46f3-8884-b06b90aa07d9]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:56:25 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d1e107-f97e-47ac-9159-f501288882e2]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:56:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-933fad38-2417-473f-91bd-3d6f106cb2ec tempest-VolumesActionsTest-1897970757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:56:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e9e896b-8534-41b3-879a-18e0fc5ab1df_sx1sj_41devstack@QuobyteHD {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:56:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-933fad38-2417-473f-91bd-3d6f106cb2ec tempest-VolumesActionsTest-1897970757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1" returned: 0 in 0.469s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:56:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-933fad38-2417-473f-91bd-3d6f106cb2ec tempest-VolumesActionsTest-1897970757 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:56:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e9e896b-8534-41b3-879a-18e0fc5ab1df_sx1sj_41devstack@QuobyteHD" returned: 0 in 0.527s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:56:26 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] 1e9e896b-8534-41b3-879a-18e0fc5ab1df was qcow2, converting to raw {{(pid=83176) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 18 11:56:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1e9e896b-8534-41b3-879a-18e0fc5ab1df_sx1sj_41devstack@QuobyteHD /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-ae74cbdf-8629-41fc-b1ac-3a3c24db2401 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:56:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-933fad38-2417-473f-91bd-3d6f106cb2ec tempest-VolumesActionsTest-1897970757 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1" returned: 0 in 0.178s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:56:26 devstack quobyte-client[83193]: System call of process 95851 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:56:26 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=121, name=volume-ae74cbdf-8629-41fc-b1ac-3a3c24db2401, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:56:26 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-933fad38-2417-473f-91bd-3d6f106cb2ec tempest-VolumesActionsTest-1897970757 None] Lock "cinder-quobyte-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1" released by "delete_volume" :: held 0.818s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:56:26 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-933fad38-2417-473f-91bd-3d6f106cb2ec tempest-VolumesActionsTest-1897970757 None] Created reservations ['35257de5-ea77-4b2a-a045-9ee9dc871342', 'c3091e30-0f38-4b71-8295-bf0c8c2d7fa5', '2e933015-3dec-4547-a482-099453ae7534', '60f52375-845c-4f70-b531-2b6e2470db9b'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:56:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-933fad38-2417-473f-91bd-3d6f106cb2ec tempest-VolumesActionsTest-1897970757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:56:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-933fad38-2417-473f-91bd-3d6f106cb2ec tempest-VolumesActionsTest-1897970757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:56:27 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-933fad38-2417-473f-91bd-3d6f106cb2ec tempest-VolumesActionsTest-1897970757 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:56:27 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-933fad38-2417-473f-91bd-3d6f106cb2ec tempest-VolumesActionsTest-1897970757 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:56:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-933fad38-2417-473f-91bd-3d6f106cb2ec tempest-VolumesActionsTest-1897970757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:56:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-933fad38-2417-473f-91bd-3d6f106cb2ec tempest-VolumesActionsTest-1897970757 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:56:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-933fad38-2417-473f-91bd-3d6f106cb2ec tempest-VolumesActionsTest-1897970757 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.119s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:56:27 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-933fad38-2417-473f-91bd-3d6f106cb2ec tempest-VolumesActionsTest-1897970757 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:56:27 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-933fad38-2417-473f-91bd-3d6f106cb2ec tempest-VolumesActionsTest-1897970757 None] Deleted volume successfully.
Sep 18 11:56:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1e9e896b-8534-41b3-879a-18e0fc5ab1df_sx1sj_41devstack@QuobyteHD /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-ae74cbdf-8629-41fc-b1ac-3a3c24db2401" returned: 0 in 1.205s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:56:27 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1e9e896b-8534-41b3-879a-18e0fc5ab1df_sx1sj_41devstack@QuobyteHD, size 112.00 MB, duration 1.21 sec, destination /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-ae74cbdf-8629-41fc-b1ac-3a3c24db2401 {{(pid=83176) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 11:56:27 devstack cinder-volume[83176]: INFO cinder.image.image_utils [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Converted 112.00 MB image at 92.65 MB/s
Sep 18 11:56:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-ae74cbdf-8629-41fc-b1ac-3a3c24db2401 1G {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:56:27 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-933fad38-2417-473f-91bd-3d6f106cb2ec tempest-VolumesActionsTest-1897970757 None] Lock "cinder-48dbf52d-c9a0-4777-bc2b-ea232f24fdb1-delete_volume" released by "delete_volume" :: held 2.480s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:56:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-ae74cbdf-8629-41fc-b1ac-3a3c24db2401 1G" returned: 0 in 0.277s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:56:27 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79a380b-64cd-4066-8eca-fd1f5093288e]: (4, 'raw') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:56:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-ae74cbdf-8629-41fc-b1ac-3a3c24db2401 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:56:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-ae74cbdf-8629-41fc-b1ac-3a3c24db2401" returned: 0 in 0.450s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:56:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-ae74cbdf-8629-41fc-b1ac-3a3c24db2401 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:56:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-ae74cbdf-8629-41fc-b1ac-3a3c24db2401" returned: 1 in 0.480s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:56:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-ae74cbdf-8629-41fc-b1ac-3a3c24db2401' failed. Not Retrying. {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 11:56:28 devstack cinder-volume[83176]: DEBUG cinder.volume.volume_utils [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Downloaded image 1e9e896b-8534-41b3-879a-18e0fc5ab1df ((None, [{'url': 'file:///opt/stack/data/glance/images/1e9e896b-8534-41b3-879a-18e0fc5ab1df', 'metadata': {}}])) to volume ae74cbdf-8629-41fc-b1ac-3a3c24db2401 successfully. {{(pid=83176) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 18 11:56:28 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Temporary image 1e9e896b-8534-41b3-879a-18e0fc5ab1df for user b20cf71a9e5d452f8dc11dcaac7e5cd9 is deleted. {{(pid=83176) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 18 11:56:28 devstack cinder-volume[83176]: DEBUG cinder.volume.volume_utils [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Marking volume ae74cbdf-8629-41fc-b1ac-3a3c24db2401 as bootable. {{(pid=83176) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 18 11:56:29 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Copying metadata from image 1e9e896b-8534-41b3-879a-18e0fc5ab1df to ae74cbdf-8629-41fc-b1ac-3a3c24db2401. {{(pid=83176) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 18 11:56:29 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Creating volume glance metadata for volume ae74cbdf-8629-41fc-b1ac-3a3c24db2401 backed by image 1e9e896b-8534-41b3-879a-18e0fc5ab1df with: {'image_id': '1e9e896b-8534-41b3-879a-18e0fc5ab1df', 'image_name': 'tempest-scenario-img--1285306202', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83176) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 18 11:56:29 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6307d164-048d-44c8-9e45-a4a723e980a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae74cbdf-8629-41fc-b1ac-3a3c24db2401', 'volume_size': 1, 'image_id': '1e9e896b-8534-41b3-879a-18e0fc5ab1df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e9e896b-8534-41b3-879a-18e0fc5ab1df', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1285306202', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c6c2df1694834ab9bf9346f7f582ca4c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1e9e896b-8534-41b3-879a-18e0fc5ab1df', 'created_at': datetime.datetime(2025, 9, 18, 9, 55, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 9, 55, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e9e896b-8534-41b3-879a-18e0fc5ab1df/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6ae49c3310>}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:56:29 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25f0a8b9-5117-4908-a06f-7a4ed40190a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:56:29 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Volume volume-ae74cbdf-8629-41fc-b1ac-3a3c24db2401 (ae74cbdf-8629-41fc-b1ac-3a3c24db2401): created successfully
Sep 18 11:56:29 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25f0a8b9-5117-4908-a06f-7a4ed40190a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:56:29 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Flow 'volume_create_manager' (1f7d4081-5f6a-4b5a-a3f5-6baaff6dae57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:56:29 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-30afe623-85f8-4ee5-bef8-c9508568c5ba tempest-TestInstancesWithCinderVolumes-262508111 None] Created volume successfully.
Sep 18 11:56:36 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-5dd39688-c46a-4962-8c17-4516fd384dc2 tempest-VolumesCloneNegativeTest-289499028 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:56:36 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dd39688-c46a-4962-8c17-4516fd384dc2 tempest-VolumesCloneNegativeTest-289499028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:56:36 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-5dd39688-c46a-4962-8c17-4516fd384dc2 tempest-VolumesCloneNegativeTest-289499028 None] Flow 'volume_create_manager' (eaeda1e2-12b3-44ad-923d-c83605b09ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:56:36 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-5dd39688-c46a-4962-8c17-4516fd384dc2 tempest-VolumesCloneNegativeTest-289499028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de2b0f72-0755-4a3e-9244-c7f85c21fd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:56:36 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-5dd39688-c46a-4962-8c17-4516fd384dc2 tempest-VolumesCloneNegativeTest-289499028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de2b0f72-0755-4a3e-9244-c7f85c21fd9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:56:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-886473735',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8baf50e7-b838-41a5-b129-b1ca4ed3ed18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3eafd05116a4a8284498b53fd3e6a91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:56:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:56:37Z,use_quota=True,user_id='ca04c40976da4c2b8ad80083ef07568c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:56:36 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-5dd39688-c46a-4962-8c17-4516fd384dc2 tempest-VolumesCloneNegativeTest-289499028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54ce6666-b64e-4df0-8ff3-ceac46af4fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:56:36 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-5dd39688-c46a-4962-8c17-4516fd384dc2 tempest-VolumesCloneNegativeTest-289499028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54ce6666-b64e-4df0-8ff3-ceac46af4fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:56:36 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-5dd39688-c46a-4962-8c17-4516fd384dc2 tempest-VolumesCloneNegativeTest-289499028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d628ca72-7824-4349-84da-4737eb394f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:56:36 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-5dd39688-c46a-4962-8c17-4516fd384dc2 tempest-VolumesCloneNegativeTest-289499028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d628ca72-7824-4349-84da-4737eb394f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8baf50e7-b838-41a5-b129-b1ca4ed3ed18', 'volume_name': 'volume-8baf50e7-b838-41a5-b129-b1ca4ed3ed18', 'volume_size': 2}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:56:36 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-5dd39688-c46a-4962-8c17-4516fd384dc2 tempest-VolumesCloneNegativeTest-289499028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3563f98b-119a-4b05-a2d8-b3e69a3b24af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:56:36 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-5dd39688-c46a-4962-8c17-4516fd384dc2 tempest-VolumesCloneNegativeTest-289499028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3563f98b-119a-4b05-a2d8-b3e69a3b24af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:56:36 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-5dd39688-c46a-4962-8c17-4516fd384dc2 tempest-VolumesCloneNegativeTest-289499028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3d8461e-8e95-4427-af82-1d5f63d99ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:56:36 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-5dd39688-c46a-4962-8c17-4516fd384dc2 tempest-VolumesCloneNegativeTest-289499028 None] Volume 8baf50e7-b838-41a5-b129-b1ca4ed3ed18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8baf50e7-b838-41a5-b129-b1ca4ed3ed18', 'volume_size': 2}
Sep 18 11:56:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-5dd39688-c46a-4962-8c17-4516fd384dc2 tempest-VolumesCloneNegativeTest-289499028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:56:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-5dd39688-c46a-4962-8c17-4516fd384dc2 tempest-VolumesCloneNegativeTest-289499028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:56:36 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-5dd39688-c46a-4962-8c17-4516fd384dc2 tempest-VolumesCloneNegativeTest-289499028 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:56:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-886473735',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8baf50e7-b838-41a5-b129-b1ca4ed3ed18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3eafd05116a4a8284498b53fd3e6a91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:56:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:56:37Z,use_quota=True,user_id='ca04c40976da4c2b8ad80083ef07568c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:56:36 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-5dd39688-c46a-4962-8c17-4516fd384dc2 tempest-VolumesCloneNegativeTest-289499028 None] Creating volume 8baf50e7-b838-41a5-b129-b1ca4ed3ed18 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:56:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-5dd39688-c46a-4962-8c17-4516fd384dc2 tempest-VolumesCloneNegativeTest-289499028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:56:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-5dd39688-c46a-4962-8c17-4516fd384dc2 tempest-VolumesCloneNegativeTest-289499028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:56:36 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-5dd39688-c46a-4962-8c17-4516fd384dc2 tempest-VolumesCloneNegativeTest-289499028 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:56:36 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-5dd39688-c46a-4962-8c17-4516fd384dc2 tempest-VolumesCloneNegativeTest-289499028 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:56:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-5dd39688-c46a-4962-8c17-4516fd384dc2 tempest-VolumesCloneNegativeTest-289499028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:56:36 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-5dd39688-c46a-4962-8c17-4516fd384dc2 tempest-VolumesCloneNegativeTest-289499028 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:56:36 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-5dd39688-c46a-4962-8c17-4516fd384dc2 tempest-VolumesCloneNegativeTest-289499028 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:56:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5dd39688-c46a-4962-8c17-4516fd384dc2 tempest-VolumesCloneNegativeTest-289499028 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8baf50e7-b838-41a5-b129-b1ca4ed3ed18 2147483648 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:56:36 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=122, name=volume-8baf50e7-b838-41a5-b129-b1ca4ed3ed18, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:56:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5dd39688-c46a-4962-8c17-4516fd384dc2 tempest-VolumesCloneNegativeTest-289499028 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8baf50e7-b838-41a5-b129-b1ca4ed3ed18 2147483648" returned: 0 in 0.507s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:56:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5dd39688-c46a-4962-8c17-4516fd384dc2 tempest-VolumesCloneNegativeTest-289499028 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8baf50e7-b838-41a5-b129-b1ca4ed3ed18 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:56:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5dd39688-c46a-4962-8c17-4516fd384dc2 tempest-VolumesCloneNegativeTest-289499028 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8baf50e7-b838-41a5-b129-b1ca4ed3ed18" returned: 0 in 0.149s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:56:37 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-5dd39688-c46a-4962-8c17-4516fd384dc2 tempest-VolumesCloneNegativeTest-289499028 None] <== create_volume: return (741ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:56:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-5dd39688-c46a-4962-8c17-4516fd384dc2 tempest-VolumesCloneNegativeTest-289499028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:56:37 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-5dd39688-c46a-4962-8c17-4516fd384dc2 tempest-VolumesCloneNegativeTest-289499028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3d8461e-8e95-4427-af82-1d5f63d99ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8baf50e7-b838-41a5-b129-b1ca4ed3ed18', 'volume_size': 2}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:56:37 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-5dd39688-c46a-4962-8c17-4516fd384dc2 tempest-VolumesCloneNegativeTest-289499028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69d679d3-4c5d-406e-9ce5-3f59c1f0f007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:56:37 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-5dd39688-c46a-4962-8c17-4516fd384dc2 tempest-VolumesCloneNegativeTest-289499028 None] Volume volume-8baf50e7-b838-41a5-b129-b1ca4ed3ed18 (8baf50e7-b838-41a5-b129-b1ca4ed3ed18): created successfully
Sep 18 11:56:37 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-5dd39688-c46a-4962-8c17-4516fd384dc2 tempest-VolumesCloneNegativeTest-289499028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69d679d3-4c5d-406e-9ce5-3f59c1f0f007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:56:37 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-5dd39688-c46a-4962-8c17-4516fd384dc2 tempest-VolumesCloneNegativeTest-289499028 None] Flow 'volume_create_manager' (eaeda1e2-12b3-44ad-923d-c83605b09ab3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:56:38 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-5dd39688-c46a-4962-8c17-4516fd384dc2 tempest-VolumesCloneNegativeTest-289499028 None] Created volume successfully.
Sep 18 11:56:39 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-d376dded-eef6-40ee-b664-7ce9bb980162 tempest-VolumesCloneNegativeTest-289499028 None] Acquiring lock "cinder-8baf50e7-b838-41a5-b129-b1ca4ed3ed18-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:56:39 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-d376dded-eef6-40ee-b664-7ce9bb980162 tempest-VolumesCloneNegativeTest-289499028 None] Lock "cinder-8baf50e7-b838-41a5-b129-b1ca4ed3ed18-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:56:39 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-d376dded-eef6-40ee-b664-7ce9bb980162 tempest-VolumesCloneNegativeTest-289499028 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:56:39 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-d376dded-eef6-40ee-b664-7ce9bb980162 tempest-VolumesCloneNegativeTest-289499028 None] Acquiring lock "cinder-quobyte-8baf50e7-b838-41a5-b129-b1ca4ed3ed18" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:56:39 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-d376dded-eef6-40ee-b664-7ce9bb980162 tempest-VolumesCloneNegativeTest-289499028 None] Lock "cinder-quobyte-8baf50e7-b838-41a5-b129-b1ca4ed3ed18" acquired by "delete_volume" :: waited 0.025s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:56:39 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0e08a7-328b-4653-8faa-e9a15c821019]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:56:39 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d376dded-eef6-40ee-b664-7ce9bb980162 tempest-VolumesCloneNegativeTest-289499028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8baf50e7-b838-41a5-b129-b1ca4ed3ed18 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:56:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-8542ca1e-17a6-42d5-893a-f750c0927c2a req-976d839f-0710-43bf-acd8-232ab2e97ec5 tempest-TestInstancesWithCinderVolumes-262508111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:56:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-8542ca1e-17a6-42d5-893a-f750c0927c2a req-976d839f-0710-43bf-acd8-232ab2e97ec5 tempest-TestInstancesWithCinderVolumes-262508111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.010s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:56:40 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab46cfb-dcf9-47e0-bcfa-7cc7d7bafbf1]: (4, 'raw') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:56:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-8542ca1e-17a6-42d5-893a-f750c0927c2a req-976d839f-0710-43bf-acd8-232ab2e97ec5 tempest-TestInstancesWithCinderVolumes-262508111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-ae74cbdf-8629-41fc-b1ac-3a3c24db2401 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:56:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d376dded-eef6-40ee-b664-7ce9bb980162 tempest-VolumesCloneNegativeTest-289499028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8baf50e7-b838-41a5-b129-b1ca4ed3ed18" returned: 0 in 0.782s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:56:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d376dded-eef6-40ee-b664-7ce9bb980162 tempest-VolumesCloneNegativeTest-289499028 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8baf50e7-b838-41a5-b129-b1ca4ed3ed18 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:56:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d376dded-eef6-40ee-b664-7ce9bb980162 tempest-VolumesCloneNegativeTest-289499028 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8baf50e7-b838-41a5-b129-b1ca4ed3ed18" returned: 0 in 0.149s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:56:40 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-d376dded-eef6-40ee-b664-7ce9bb980162 tempest-VolumesCloneNegativeTest-289499028 None] Lock "cinder-quobyte-8baf50e7-b838-41a5-b129-b1ca4ed3ed18" released by "delete_volume" :: held 1.277s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:56:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-8542ca1e-17a6-42d5-893a-f750c0927c2a req-976d839f-0710-43bf-acd8-232ab2e97ec5 tempest-TestInstancesWithCinderVolumes-262508111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-ae74cbdf-8629-41fc-b1ac-3a3c24db2401" returned: 0 in 0.862s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:56:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-8542ca1e-17a6-42d5-893a-f750c0927c2a req-976d839f-0710-43bf-acd8-232ab2e97ec5 tempest-TestInstancesWithCinderVolumes-262508111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-ae74cbdf-8629-41fc-b1ac-3a3c24db2401 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:56:41 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-d376dded-eef6-40ee-b664-7ce9bb980162 tempest-VolumesCloneNegativeTest-289499028 None] Created reservations ['750019cd-22b9-406a-9bd2-031ba2762c3c', 'f31795ed-e7fa-426c-b9f8-f101048645e2', '465b1452-465d-42d5-961e-5ede3e1085e9', '1c0e161f-ce95-49ac-b8d6-e7ef827a81f6'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:56:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-8542ca1e-17a6-42d5-893a-f750c0927c2a req-976d839f-0710-43bf-acd8-232ab2e97ec5 tempest-TestInstancesWithCinderVolumes-262508111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-ae74cbdf-8629-41fc-b1ac-3a3c24db2401" returned: 1 in 0.599s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:56:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-8542ca1e-17a6-42d5-893a-f750c0927c2a req-976d839f-0710-43bf-acd8-232ab2e97ec5 tempest-TestInstancesWithCinderVolumes-262508111 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-ae74cbdf-8629-41fc-b1ac-3a3c24db2401' failed. Not Retrying. {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 11:56:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-8542ca1e-17a6-42d5-893a-f750c0927c2a req-976d839f-0710-43bf-acd8-232ab2e97ec5 tempest-TestInstancesWithCinderVolumes-262508111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.540s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:56:41 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-8542ca1e-17a6-42d5-893a-f750c0927c2a req-976d839f-0710-43bf-acd8-232ab2e97ec5 tempest-TestInstancesWithCinderVolumes-262508111 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8', 'name': 'volume-ae74cbdf-8629-41fc-b1ac-3a3c24db2401', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c8b8c24a-57c3-4658-87ab-4a796340f8bf', 'enforce_multipath': True} {{(pid=83176) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 11:56:41 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-8542ca1e-17a6-42d5-893a-f750c0927c2a req-976d839f-0710-43bf-acd8-232ab2e97ec5 tempest-TestInstancesWithCinderVolumes-262508111 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:56:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d376dded-eef6-40ee-b664-7ce9bb980162 tempest-VolumesCloneNegativeTest-289499028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:56:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d376dded-eef6-40ee-b664-7ce9bb980162 tempest-VolumesCloneNegativeTest-289499028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:56:41 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-d376dded-eef6-40ee-b664-7ce9bb980162 tempest-VolumesCloneNegativeTest-289499028 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:56:41 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-d376dded-eef6-40ee-b664-7ce9bb980162 tempest-VolumesCloneNegativeTest-289499028 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:56:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d376dded-eef6-40ee-b664-7ce9bb980162 tempest-VolumesCloneNegativeTest-289499028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:56:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d376dded-eef6-40ee-b664-7ce9bb980162 tempest-VolumesCloneNegativeTest-289499028 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:56:42 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-8542ca1e-17a6-42d5-893a-f750c0927c2a req-976d839f-0710-43bf-acd8-232ab2e97ec5 tempest-TestInstancesWithCinderVolumes-262508111 None] attachment_update completed successfully.
Sep 18 11:56:42 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d376dded-eef6-40ee-b664-7ce9bb980162 tempest-VolumesCloneNegativeTest-289499028 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.469s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:56:42 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-d376dded-eef6-40ee-b664-7ce9bb980162 tempest-VolumesCloneNegativeTest-289499028 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:56:42 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-d376dded-eef6-40ee-b664-7ce9bb980162 tempest-VolumesCloneNegativeTest-289499028 None] Deleted volume successfully.
Sep 18 11:56:42 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-d376dded-eef6-40ee-b664-7ce9bb980162 tempest-VolumesCloneNegativeTest-289499028 None] Lock "cinder-8baf50e7-b838-41a5-b129-b1ca4ed3ed18-delete_volume" released by "delete_volume" :: held 2.983s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:56:52 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=26,cinder:UPDATE=20,cinder:DELETE=2,cinder:INSERT=11 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:56:52 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:UPDATE=34,cinder:DELETE=4,cinder:SELECT=24,cinder:INSERT=6 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:57:13 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 11:57:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:57:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:57:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:57:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:57:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:57:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:57:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.170s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:57:14 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:57:53 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-6cacbb44-d5ab-4cac-999e-a2842d8b9379 tempest-TestMinimumBasicScenario-586190042 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:57:53 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cacbb44-d5ab-4cac-999e-a2842d8b9379 tempest-TestMinimumBasicScenario-586190042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 11:57:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-6cacbb44-d5ab-4cac-999e-a2842d8b9379 tempest-TestMinimumBasicScenario-586190042 None] Flow 'volume_create_manager' (f38871b3-b88a-493a-99bc-c341bc25f65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:57:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-6cacbb44-d5ab-4cac-999e-a2842d8b9379 tempest-TestMinimumBasicScenario-586190042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90ea3c0d-9228-4d8c-91ef-dcb1b4f9a090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:57:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-6cacbb44-d5ab-4cac-999e-a2842d8b9379 tempest-TestMinimumBasicScenario-586190042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90ea3c0d-9228-4d8c-91ef-dcb1b4f9a090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-110908487',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bcedc01-ecc8-4b30-b202-15c6020f53bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a40186b33e0641ceb757f11eb0917fa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:57:53Z,use_quota=True,user_id='0eae77120a0445cf863e06d0883bc298',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:57:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-6cacbb44-d5ab-4cac-999e-a2842d8b9379 tempest-TestMinimumBasicScenario-586190042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f3450e8-5610-4d6a-9a9d-9c895ae8c9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:57:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-6cacbb44-d5ab-4cac-999e-a2842d8b9379 tempest-TestMinimumBasicScenario-586190042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f3450e8-5610-4d6a-9a9d-9c895ae8c9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:57:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-6cacbb44-d5ab-4cac-999e-a2842d8b9379 tempest-TestMinimumBasicScenario-586190042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (800cb912-ae97-4e48-9a8e-c3bd32c54c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:57:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-6cacbb44-d5ab-4cac-999e-a2842d8b9379 tempest-TestMinimumBasicScenario-586190042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (800cb912-ae97-4e48-9a8e-c3bd32c54c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bcedc01-ecc8-4b30-b202-15c6020f53bf', 'volume_name': 'volume-0bcedc01-ecc8-4b30-b202-15c6020f53bf', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:57:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-6cacbb44-d5ab-4cac-999e-a2842d8b9379 tempest-TestMinimumBasicScenario-586190042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (951d242c-3184-4a1c-b9db-b4792ae580d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:57:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-6cacbb44-d5ab-4cac-999e-a2842d8b9379 tempest-TestMinimumBasicScenario-586190042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (951d242c-3184-4a1c-b9db-b4792ae580d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:57:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-6cacbb44-d5ab-4cac-999e-a2842d8b9379 tempest-TestMinimumBasicScenario-586190042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db0a2fb2-9215-41f1-b849-076a1ab2a765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:57:53 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-6cacbb44-d5ab-4cac-999e-a2842d8b9379 tempest-TestMinimumBasicScenario-586190042 None] Volume 0bcedc01-ecc8-4b30-b202-15c6020f53bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bcedc01-ecc8-4b30-b202-15c6020f53bf', 'volume_size': 1}
Sep 18 11:57:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-6cacbb44-d5ab-4cac-999e-a2842d8b9379 tempest-TestMinimumBasicScenario-586190042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:57:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-6cacbb44-d5ab-4cac-999e-a2842d8b9379 tempest-TestMinimumBasicScenario-586190042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:57:53 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-6cacbb44-d5ab-4cac-999e-a2842d8b9379 tempest-TestMinimumBasicScenario-586190042 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T09:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-110908487',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bcedc01-ecc8-4b30-b202-15c6020f53bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a40186b33e0641ceb757f11eb0917fa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:57:53Z,use_quota=True,user_id='0eae77120a0445cf863e06d0883bc298',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 11:57:53 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-6cacbb44-d5ab-4cac-999e-a2842d8b9379 tempest-TestMinimumBasicScenario-586190042 None] Creating volume 0bcedc01-ecc8-4b30-b202-15c6020f53bf {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 11:57:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-6cacbb44-d5ab-4cac-999e-a2842d8b9379 tempest-TestMinimumBasicScenario-586190042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:57:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-6cacbb44-d5ab-4cac-999e-a2842d8b9379 tempest-TestMinimumBasicScenario-586190042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:57:53 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-6cacbb44-d5ab-4cac-999e-a2842d8b9379 tempest-TestMinimumBasicScenario-586190042 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:57:53 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-6cacbb44-d5ab-4cac-999e-a2842d8b9379 tempest-TestMinimumBasicScenario-586190042 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:57:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-6cacbb44-d5ab-4cac-999e-a2842d8b9379 tempest-TestMinimumBasicScenario-586190042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:57:53 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-6cacbb44-d5ab-4cac-999e-a2842d8b9379 tempest-TestMinimumBasicScenario-586190042 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 11:57:53 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-6cacbb44-d5ab-4cac-999e-a2842d8b9379 tempest-TestMinimumBasicScenario-586190042 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 11:57:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6cacbb44-d5ab-4cac-999e-a2842d8b9379 tempest-TestMinimumBasicScenario-586190042 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-0bcedc01-ecc8-4b30-b202-15c6020f53bf 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:57:54 devstack quobyte-client[83193]: System call of process 96624 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:57:54 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=123, name=volume-0bcedc01-ecc8-4b30-b202-15c6020f53bf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 11:57:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6cacbb44-d5ab-4cac-999e-a2842d8b9379 tempest-TestMinimumBasicScenario-586190042 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-0bcedc01-ecc8-4b30-b202-15c6020f53bf 1073741824" returned: 0 in 0.470s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:57:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6cacbb44-d5ab-4cac-999e-a2842d8b9379 tempest-TestMinimumBasicScenario-586190042 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-0bcedc01-ecc8-4b30-b202-15c6020f53bf {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:57:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6cacbb44-d5ab-4cac-999e-a2842d8b9379 tempest-TestMinimumBasicScenario-586190042 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-0bcedc01-ecc8-4b30-b202-15c6020f53bf" returned: 0 in 0.119s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:57:54 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-6cacbb44-d5ab-4cac-999e-a2842d8b9379 tempest-TestMinimumBasicScenario-586190042 None] <== create_volume: return (711ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 11:57:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-6cacbb44-d5ab-4cac-999e-a2842d8b9379 tempest-TestMinimumBasicScenario-586190042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:57:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-6cacbb44-d5ab-4cac-999e-a2842d8b9379 tempest-TestMinimumBasicScenario-586190042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db0a2fb2-9215-41f1-b849-076a1ab2a765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bcedc01-ecc8-4b30-b202-15c6020f53bf', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:57:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-6cacbb44-d5ab-4cac-999e-a2842d8b9379 tempest-TestMinimumBasicScenario-586190042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5e02a6d-7ff3-4a48-877b-8e5fb4fe9b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 11:57:54 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-6cacbb44-d5ab-4cac-999e-a2842d8b9379 tempest-TestMinimumBasicScenario-586190042 None] Volume volume-0bcedc01-ecc8-4b30-b202-15c6020f53bf (0bcedc01-ecc8-4b30-b202-15c6020f53bf): created successfully
Sep 18 11:57:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-6cacbb44-d5ab-4cac-999e-a2842d8b9379 tempest-TestMinimumBasicScenario-586190042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5e02a6d-7ff3-4a48-877b-8e5fb4fe9b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 11:57:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-6cacbb44-d5ab-4cac-999e-a2842d8b9379 tempest-TestMinimumBasicScenario-586190042 None] Flow 'volume_create_manager' (f38871b3-b88a-493a-99bc-c341bc25f65b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 11:57:54 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-6cacbb44-d5ab-4cac-999e-a2842d8b9379 tempest-TestMinimumBasicScenario-586190042 None] Created volume successfully.
Sep 18 11:57:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-df1fb251-57f6-48cf-9902-34b5bca789c8 req-439acfc3-9460-4cac-8d52-869289af6e96 tempest-TestMinimumBasicScenario-586190042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:57:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-df1fb251-57f6-48cf-9902-34b5bca789c8 req-439acfc3-9460-4cac-8d52-869289af6e96 tempest-TestMinimumBasicScenario-586190042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:57:59 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c7ae60-5a78-462f-9ad4-b9347eea2cff]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:57:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-df1fb251-57f6-48cf-9902-34b5bca789c8 req-439acfc3-9460-4cac-8d52-869289af6e96 tempest-TestMinimumBasicScenario-586190042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-0bcedc01-ecc8-4b30-b202-15c6020f53bf {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:58:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-df1fb251-57f6-48cf-9902-34b5bca789c8 req-439acfc3-9460-4cac-8d52-869289af6e96 tempest-TestMinimumBasicScenario-586190042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-0bcedc01-ecc8-4b30-b202-15c6020f53bf" returned: 0 in 0.516s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:58:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-df1fb251-57f6-48cf-9902-34b5bca789c8 req-439acfc3-9460-4cac-8d52-869289af6e96 tempest-TestMinimumBasicScenario-586190042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.618s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:58:01 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-df1fb251-57f6-48cf-9902-34b5bca789c8 req-439acfc3-9460-4cac-8d52-869289af6e96 tempest-TestMinimumBasicScenario-586190042 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8', 'name': 'volume-0bcedc01-ecc8-4b30-b202-15c6020f53bf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9a4bd780-f86d-4fa7-8665-e666335231bc', 'enforce_multipath': True} {{(pid=83176) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 11:58:01 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-df1fb251-57f6-48cf-9902-34b5bca789c8 req-439acfc3-9460-4cac-8d52-869289af6e96 tempest-TestMinimumBasicScenario-586190042 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:58:01 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-df1fb251-57f6-48cf-9902-34b5bca789c8 req-439acfc3-9460-4cac-8d52-869289af6e96 tempest-TestMinimumBasicScenario-586190042 None] attachment_update completed successfully.
Sep 18 11:58:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-eab40f6e-15dc-4421-bf70-c8825c8112dc req-bcde640d-4127-438f-a29d-d2f13affe7ac tempest-TestInstancesWithCinderVolumes-262508111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:58:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-eab40f6e-15dc-4421-bf70-c8825c8112dc req-bcde640d-4127-438f-a29d-d2f13affe7ac tempest-TestInstancesWithCinderVolumes-262508111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.017s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:58:08 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[34cd3cd8-aaf9-42d6-b190-cef3b3ca58e8]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:58:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-eab40f6e-15dc-4421-bf70-c8825c8112dc req-bcde640d-4127-438f-a29d-d2f13affe7ac tempest-TestInstancesWithCinderVolumes-262508111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-52703dec-d446-4b87-8760-6973ab489700 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:58:09 devstack quobyte-client[83193]: System call of process 96668 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 11:58:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-eab40f6e-15dc-4421-bf70-c8825c8112dc req-bcde640d-4127-438f-a29d-d2f13affe7ac tempest-TestInstancesWithCinderVolumes-262508111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-52703dec-d446-4b87-8760-6973ab489700" returned: 0 in 0.904s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:58:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-eab40f6e-15dc-4421-bf70-c8825c8112dc req-bcde640d-4127-438f-a29d-d2f13affe7ac tempest-TestInstancesWithCinderVolumes-262508111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.052s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:58:10 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-eab40f6e-15dc-4421-bf70-c8825c8112dc req-bcde640d-4127-438f-a29d-d2f13affe7ac tempest-TestInstancesWithCinderVolumes-262508111 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8', 'name': 'volume-52703dec-d446-4b87-8760-6973ab489700', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'de9963d9-51fd-441b-a028-4983a37da60e', 'enforce_multipath': True} {{(pid=83176) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 11:58:10 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-eab40f6e-15dc-4421-bf70-c8825c8112dc req-bcde640d-4127-438f-a29d-d2f13affe7ac tempest-TestInstancesWithCinderVolumes-262508111 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:58:10 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-eab40f6e-15dc-4421-bf70-c8825c8112dc req-bcde640d-4127-438f-a29d-d2f13affe7ac tempest-TestInstancesWithCinderVolumes-262508111 None] attachment_update completed successfully.
Sep 18 11:58:13 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 11:58:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:58:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:58:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:58:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:58:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:58:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:58:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.278s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:58:14 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:58:20 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:UPDATE=4,cinder:SELECT=16,cinder:DELETE=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:58:20 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=8,cinder:UPDATE=6 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:58:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-6ddcab6d-dae3-4650-a698-8659c5d58d9b req-2ac5fc99-9133-44f4-a924-d2123ed94ad4 tempest-TestInstancesWithCinderVolumes-262508111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:58:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-6ddcab6d-dae3-4650-a698-8659c5d58d9b req-2ac5fc99-9133-44f4-a924-d2123ed94ad4 tempest-TestInstancesWithCinderVolumes-262508111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:58:23 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e80eed2-defe-4a15-8eb7-97dd025721cb]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:58:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-6ddcab6d-dae3-4650-a698-8659c5d58d9b req-2ac5fc99-9133-44f4-a924-d2123ed94ad4 tempest-TestInstancesWithCinderVolumes-262508111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-beb0c09b-b7a1-4cfd-bcd4-08f26884bd2a {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:58:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-6ddcab6d-dae3-4650-a698-8659c5d58d9b req-2ac5fc99-9133-44f4-a924-d2123ed94ad4 tempest-TestInstancesWithCinderVolumes-262508111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-beb0c09b-b7a1-4cfd-bcd4-08f26884bd2a" returned: 0 in 0.503s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:58:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-6ddcab6d-dae3-4650-a698-8659c5d58d9b req-2ac5fc99-9133-44f4-a924-d2123ed94ad4 tempest-TestInstancesWithCinderVolumes-262508111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.579s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:58:24 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-6ddcab6d-dae3-4650-a698-8659c5d58d9b req-2ac5fc99-9133-44f4-a924-d2123ed94ad4 tempest-TestInstancesWithCinderVolumes-262508111 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8', 'name': 'volume-beb0c09b-b7a1-4cfd-bcd4-08f26884bd2a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '75b87db8-76b7-4c1a-a150-41eec2fb1d9a', 'enforce_multipath': True} {{(pid=83176) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 11:58:24 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-6ddcab6d-dae3-4650-a698-8659c5d58d9b req-2ac5fc99-9133-44f4-a924-d2123ed94ad4 tempest-TestInstancesWithCinderVolumes-262508111 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:58:24 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-6ddcab6d-dae3-4650-a698-8659c5d58d9b req-2ac5fc99-9133-44f4-a924-d2123ed94ad4 tempest-TestInstancesWithCinderVolumes-262508111 None] attachment_update completed successfully.
Sep 18 11:58:43 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:58:43 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:58:58 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-07b22070-4443-454f-b10d-425000a944f9 req-9af5ad36-b178-4212-a4d2-6eaa39938d78 tempest-TestInstancesWithCinderVolumes-262508111 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:58:58 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-07b22070-4443-454f-b10d-425000a944f9 req-9af5ad36-b178-4212-a4d2-6eaa39938d78 tempest-TestInstancesWithCinderVolumes-262508111 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:58:58 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-07b22070-4443-454f-b10d-425000a944f9 req-9af5ad36-b178-4212-a4d2-6eaa39938d78 tempest-TestInstancesWithCinderVolumes-262508111 None] Terminate volume connection completed successfully.
Sep 18 11:58:58 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-07b22070-4443-454f-b10d-425000a944f9 req-9af5ad36-b178-4212-a4d2-6eaa39938d78 tempest-TestInstancesWithCinderVolumes-262508111 None] Deleting attachment de9963d9-51fd-441b-a028-4983a37da60e. {{(pid=83176) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 11:59:00 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-bf9a4bcd-f03f-4f48-b001-5abec69b98c6 tempest-TestInstancesWithCinderVolumes-262508111 None] Acquiring lock "cinder-52703dec-d446-4b87-8760-6973ab489700-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:59:00 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-bf9a4bcd-f03f-4f48-b001-5abec69b98c6 tempest-TestInstancesWithCinderVolumes-262508111 None] Lock "cinder-52703dec-d446-4b87-8760-6973ab489700-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:59:00 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-bf9a4bcd-f03f-4f48-b001-5abec69b98c6 tempest-TestInstancesWithCinderVolumes-262508111 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:59:00 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-bf9a4bcd-f03f-4f48-b001-5abec69b98c6 tempest-TestInstancesWithCinderVolumes-262508111 None] Acquiring lock "cinder-quobyte-52703dec-d446-4b87-8760-6973ab489700" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:59:00 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-bf9a4bcd-f03f-4f48-b001-5abec69b98c6 tempest-TestInstancesWithCinderVolumes-262508111 None] Lock "cinder-quobyte-52703dec-d446-4b87-8760-6973ab489700" acquired by "delete_volume" :: waited 0.014s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:59:00 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8a077a-0ee9-4956-afaf-05fe12e9a6c3]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:59:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-bf9a4bcd-f03f-4f48-b001-5abec69b98c6 tempest-TestInstancesWithCinderVolumes-262508111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-52703dec-d446-4b87-8760-6973ab489700 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:59:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-bf9a4bcd-f03f-4f48-b001-5abec69b98c6 tempest-TestInstancesWithCinderVolumes-262508111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-52703dec-d446-4b87-8760-6973ab489700" returned: 0 in 0.475s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:59:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-bf9a4bcd-f03f-4f48-b001-5abec69b98c6 tempest-TestInstancesWithCinderVolumes-262508111 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-52703dec-d446-4b87-8760-6973ab489700 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:59:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-bf9a4bcd-f03f-4f48-b001-5abec69b98c6 tempest-TestInstancesWithCinderVolumes-262508111 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-52703dec-d446-4b87-8760-6973ab489700" returned: 0 in 0.104s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:59:01 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-bf9a4bcd-f03f-4f48-b001-5abec69b98c6 tempest-TestInstancesWithCinderVolumes-262508111 None] Lock "cinder-quobyte-52703dec-d446-4b87-8760-6973ab489700" released by "delete_volume" :: held 0.779s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:59:01 devstack cinder-volume[83176]: WARNING cinder.quota [None req-bf9a4bcd-f03f-4f48-b001-5abec69b98c6 tempest-TestInstancesWithCinderVolumes-262508111 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1004399141-1029611127 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1004399141-1029611127, it is now deprecated. Please use the default quota class for default quota.
Sep 18 11:59:01 devstack cinder-volume[83176]: WARNING cinder.quota [None req-bf9a4bcd-f03f-4f48-b001-5abec69b98c6 tempest-TestInstancesWithCinderVolumes-262508111 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1004399141-1029611127 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1004399141-1029611127, it is now deprecated. Please use the default quota class for default quota.
Sep 18 11:59:01 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-bf9a4bcd-f03f-4f48-b001-5abec69b98c6 tempest-TestInstancesWithCinderVolumes-262508111 None] Created reservations ['be49b3af-fc57-4aa1-9ef8-28600754434e', 'dadcde74-0a72-48e5-be4e-88425b115008', 'fb7d785f-4f8d-437f-9c27-5bf09df0813f', '7958fb52-b6da-482f-a0e8-e37dd5cf89ff'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:59:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-bf9a4bcd-f03f-4f48-b001-5abec69b98c6 tempest-TestInstancesWithCinderVolumes-262508111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:59:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-bf9a4bcd-f03f-4f48-b001-5abec69b98c6 tempest-TestInstancesWithCinderVolumes-262508111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:59:01 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-bf9a4bcd-f03f-4f48-b001-5abec69b98c6 tempest-TestInstancesWithCinderVolumes-262508111 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:59:01 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-bf9a4bcd-f03f-4f48-b001-5abec69b98c6 tempest-TestInstancesWithCinderVolumes-262508111 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:59:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-bf9a4bcd-f03f-4f48-b001-5abec69b98c6 tempest-TestInstancesWithCinderVolumes-262508111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:59:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-bf9a4bcd-f03f-4f48-b001-5abec69b98c6 tempest-TestInstancesWithCinderVolumes-262508111 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:59:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-bf9a4bcd-f03f-4f48-b001-5abec69b98c6 tempest-TestInstancesWithCinderVolumes-262508111 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.431s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:59:02 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-bf9a4bcd-f03f-4f48-b001-5abec69b98c6 tempest-TestInstancesWithCinderVolumes-262508111 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:59:02 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-bf9a4bcd-f03f-4f48-b001-5abec69b98c6 tempest-TestInstancesWithCinderVolumes-262508111 None] Deleted volume successfully.
Sep 18 11:59:03 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-bf9a4bcd-f03f-4f48-b001-5abec69b98c6 tempest-TestInstancesWithCinderVolumes-262508111 None] Lock "cinder-52703dec-d446-4b87-8760-6973ab489700-delete_volume" released by "delete_volume" :: held 3.214s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:59:11 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=6,cinder:UPDATE=12 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:59:13 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=6,cinder:INSERT=4,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:59:13 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 11:59:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:59:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:59:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:59:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:59:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:59:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:59:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.103s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:59:14 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:59:31 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-465b0bb8-a50a-40f5-8b84-05610806543d req-c2b6a106-022f-4cd8-92b2-db69eb0c8702 tempest-TestInstancesWithCinderVolumes-262508111 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:59:31 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-465b0bb8-a50a-40f5-8b84-05610806543d req-c2b6a106-022f-4cd8-92b2-db69eb0c8702 tempest-TestInstancesWithCinderVolumes-262508111 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:59:31 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-465b0bb8-a50a-40f5-8b84-05610806543d req-c2b6a106-022f-4cd8-92b2-db69eb0c8702 tempest-TestInstancesWithCinderVolumes-262508111 None] Terminate volume connection completed successfully.
Sep 18 11:59:31 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-465b0bb8-a50a-40f5-8b84-05610806543d req-c2b6a106-022f-4cd8-92b2-db69eb0c8702 tempest-TestInstancesWithCinderVolumes-262508111 None] Deleting attachment 75b87db8-76b7-4c1a-a150-41eec2fb1d9a. {{(pid=83176) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 11:59:32 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-91651fcb-003c-40f4-8331-abaaa48804a9 tempest-TestInstancesWithCinderVolumes-262508111 None] Acquiring lock "cinder-beb0c09b-b7a1-4cfd-bcd4-08f26884bd2a-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:59:32 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-91651fcb-003c-40f4-8331-abaaa48804a9 tempest-TestInstancesWithCinderVolumes-262508111 None] Lock "cinder-beb0c09b-b7a1-4cfd-bcd4-08f26884bd2a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:59:32 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-91651fcb-003c-40f4-8331-abaaa48804a9 tempest-TestInstancesWithCinderVolumes-262508111 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:59:32 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-91651fcb-003c-40f4-8331-abaaa48804a9 tempest-TestInstancesWithCinderVolumes-262508111 None] Acquiring lock "cinder-quobyte-beb0c09b-b7a1-4cfd-bcd4-08f26884bd2a" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:59:32 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-91651fcb-003c-40f4-8331-abaaa48804a9 tempest-TestInstancesWithCinderVolumes-262508111 None] Lock "cinder-quobyte-beb0c09b-b7a1-4cfd-bcd4-08f26884bd2a" acquired by "delete_volume" :: waited 0.026s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:59:32 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7267bc-a3d2-484c-a8c0-07b4223edfa3]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:59:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-91651fcb-003c-40f4-8331-abaaa48804a9 tempest-TestInstancesWithCinderVolumes-262508111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-beb0c09b-b7a1-4cfd-bcd4-08f26884bd2a {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:59:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-91651fcb-003c-40f4-8331-abaaa48804a9 tempest-TestInstancesWithCinderVolumes-262508111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-beb0c09b-b7a1-4cfd-bcd4-08f26884bd2a" returned: 0 in 0.609s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:59:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-91651fcb-003c-40f4-8331-abaaa48804a9 tempest-TestInstancesWithCinderVolumes-262508111 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-beb0c09b-b7a1-4cfd-bcd4-08f26884bd2a {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:59:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-91651fcb-003c-40f4-8331-abaaa48804a9 tempest-TestInstancesWithCinderVolumes-262508111 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-beb0c09b-b7a1-4cfd-bcd4-08f26884bd2a" returned: 0 in 0.152s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:59:33 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-91651fcb-003c-40f4-8331-abaaa48804a9 tempest-TestInstancesWithCinderVolumes-262508111 None] Lock "cinder-quobyte-beb0c09b-b7a1-4cfd-bcd4-08f26884bd2a" released by "delete_volume" :: held 0.972s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:59:34 devstack cinder-volume[83176]: WARNING cinder.quota [None req-91651fcb-003c-40f4-8331-abaaa48804a9 tempest-TestInstancesWithCinderVolumes-262508111 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-36429000-1719039658 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-36429000-1719039658, it is now deprecated. Please use the default quota class for default quota.
Sep 18 11:59:34 devstack cinder-volume[83176]: WARNING cinder.quota [None req-91651fcb-003c-40f4-8331-abaaa48804a9 tempest-TestInstancesWithCinderVolumes-262508111 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-36429000-1719039658 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-36429000-1719039658, it is now deprecated. Please use the default quota class for default quota.
Sep 18 11:59:34 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-91651fcb-003c-40f4-8331-abaaa48804a9 tempest-TestInstancesWithCinderVolumes-262508111 None] Created reservations ['9b2c9fb9-e581-4924-999c-044cafe77c14', '9f1a3b40-46d4-476d-9acc-787b5d494e88', '95085f62-3452-4e6e-a4b5-bf3255989e9f', '0f1cb59a-bff9-454f-855a-83c3ddd0b493'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:59:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-91651fcb-003c-40f4-8331-abaaa48804a9 tempest-TestInstancesWithCinderVolumes-262508111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:59:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-91651fcb-003c-40f4-8331-abaaa48804a9 tempest-TestInstancesWithCinderVolumes-262508111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:59:34 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-91651fcb-003c-40f4-8331-abaaa48804a9 tempest-TestInstancesWithCinderVolumes-262508111 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:59:34 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-91651fcb-003c-40f4-8331-abaaa48804a9 tempest-TestInstancesWithCinderVolumes-262508111 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:59:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-91651fcb-003c-40f4-8331-abaaa48804a9 tempest-TestInstancesWithCinderVolumes-262508111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:59:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-91651fcb-003c-40f4-8331-abaaa48804a9 tempest-TestInstancesWithCinderVolumes-262508111 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:59:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-91651fcb-003c-40f4-8331-abaaa48804a9 tempest-TestInstancesWithCinderVolumes-262508111 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.185s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:59:34 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-91651fcb-003c-40f4-8331-abaaa48804a9 tempest-TestInstancesWithCinderVolumes-262508111 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:59:34 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-91651fcb-003c-40f4-8331-abaaa48804a9 tempest-TestInstancesWithCinderVolumes-262508111 None] Deleted volume successfully.
Sep 18 11:59:35 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-91651fcb-003c-40f4-8331-abaaa48804a9 tempest-TestInstancesWithCinderVolumes-262508111 None] Lock "cinder-beb0c09b-b7a1-4cfd-bcd4-08f26884bd2a-delete_volume" released by "delete_volume" :: held 2.388s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:59:42 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-63f1e69b-3bd2-48d5-a60c-1538204e6635 req-2bfa220d-2e02-430e-942b-bb671ddd3325 tempest-TestInstancesWithCinderVolumes-262508111 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:59:42 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-63f1e69b-3bd2-48d5-a60c-1538204e6635 req-2bfa220d-2e02-430e-942b-bb671ddd3325 tempest-TestInstancesWithCinderVolumes-262508111 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:59:42 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-63f1e69b-3bd2-48d5-a60c-1538204e6635 req-2bfa220d-2e02-430e-942b-bb671ddd3325 tempest-TestInstancesWithCinderVolumes-262508111 None] Terminate volume connection completed successfully.
Sep 18 11:59:42 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-63f1e69b-3bd2-48d5-a60c-1538204e6635 req-2bfa220d-2e02-430e-942b-bb671ddd3325 tempest-TestInstancesWithCinderVolumes-262508111 None] Deleting attachment c8b8c24a-57c3-4658-87ab-4a796340f8bf. {{(pid=83176) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 11:59:45 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-53f1bbd5-4e4f-4fb0-a22a-1a1039e4b6d4 tempest-TestInstancesWithCinderVolumes-262508111 None] Acquiring lock "cinder-ae74cbdf-8629-41fc-b1ac-3a3c24db2401-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:59:45 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-53f1bbd5-4e4f-4fb0-a22a-1a1039e4b6d4 tempest-TestInstancesWithCinderVolumes-262508111 None] Lock "cinder-ae74cbdf-8629-41fc-b1ac-3a3c24db2401-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:59:45 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-53f1bbd5-4e4f-4fb0-a22a-1a1039e4b6d4 tempest-TestInstancesWithCinderVolumes-262508111 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 11:59:45 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-53f1bbd5-4e4f-4fb0-a22a-1a1039e4b6d4 tempest-TestInstancesWithCinderVolumes-262508111 None] Acquiring lock "cinder-quobyte-ae74cbdf-8629-41fc-b1ac-3a3c24db2401" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 11:59:45 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-53f1bbd5-4e4f-4fb0-a22a-1a1039e4b6d4 tempest-TestInstancesWithCinderVolumes-262508111 None] Lock "cinder-quobyte-ae74cbdf-8629-41fc-b1ac-3a3c24db2401" acquired by "delete_volume" :: waited 0.011s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 11:59:45 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1985e3d-f553-444d-b1cb-8b86b709a800]: (4, 'raw') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 11:59:45 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-53f1bbd5-4e4f-4fb0-a22a-1a1039e4b6d4 tempest-TestInstancesWithCinderVolumes-262508111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-ae74cbdf-8629-41fc-b1ac-3a3c24db2401 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:59:46 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-53f1bbd5-4e4f-4fb0-a22a-1a1039e4b6d4 tempest-TestInstancesWithCinderVolumes-262508111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-ae74cbdf-8629-41fc-b1ac-3a3c24db2401" returned: 0 in 0.356s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:59:46 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-53f1bbd5-4e4f-4fb0-a22a-1a1039e4b6d4 tempest-TestInstancesWithCinderVolumes-262508111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-ae74cbdf-8629-41fc-b1ac-3a3c24db2401 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:59:46 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-53f1bbd5-4e4f-4fb0-a22a-1a1039e4b6d4 tempest-TestInstancesWithCinderVolumes-262508111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-ae74cbdf-8629-41fc-b1ac-3a3c24db2401" returned: 1 in 0.383s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:59:46 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-53f1bbd5-4e4f-4fb0-a22a-1a1039e4b6d4 tempest-TestInstancesWithCinderVolumes-262508111 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-ae74cbdf-8629-41fc-b1ac-3a3c24db2401' failed. Not Retrying. {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 11:59:46 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-53f1bbd5-4e4f-4fb0-a22a-1a1039e4b6d4 tempest-TestInstancesWithCinderVolumes-262508111 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-ae74cbdf-8629-41fc-b1ac-3a3c24db2401 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:59:46 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-53f1bbd5-4e4f-4fb0-a22a-1a1039e4b6d4 tempest-TestInstancesWithCinderVolumes-262508111 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-ae74cbdf-8629-41fc-b1ac-3a3c24db2401" returned: 0 in 0.092s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:59:47 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-53f1bbd5-4e4f-4fb0-a22a-1a1039e4b6d4 tempest-TestInstancesWithCinderVolumes-262508111 None] Lock "cinder-quobyte-ae74cbdf-8629-41fc-b1ac-3a3c24db2401" released by "delete_volume" :: held 1.103s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:59:47 devstack cinder-volume[83176]: WARNING cinder.quota [None req-53f1bbd5-4e4f-4fb0-a22a-1a1039e4b6d4 tempest-TestInstancesWithCinderVolumes-262508111 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-456501697-1161096690 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-456501697-1161096690, it is now deprecated. Please use the default quota class for default quota.
Sep 18 11:59:47 devstack cinder-volume[83176]: WARNING cinder.quota [None req-53f1bbd5-4e4f-4fb0-a22a-1a1039e4b6d4 tempest-TestInstancesWithCinderVolumes-262508111 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-456501697-1161096690 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-456501697-1161096690, it is now deprecated. Please use the default quota class for default quota.
Sep 18 11:59:47 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-53f1bbd5-4e4f-4fb0-a22a-1a1039e4b6d4 tempest-TestInstancesWithCinderVolumes-262508111 None] Created reservations ['14e1e0f5-a0ff-4a37-b0d7-f178f5433d8a', 'eb1f0310-2793-46ea-96d8-8c51a6c9134f', '54865189-1fc8-4b09-b6ac-f956cf4e6c9b', '78c286dd-1404-4f59-832b-0ef12c843799'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 11:59:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-53f1bbd5-4e4f-4fb0-a22a-1a1039e4b6d4 tempest-TestInstancesWithCinderVolumes-262508111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 11:59:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-53f1bbd5-4e4f-4fb0-a22a-1a1039e4b6d4 tempest-TestInstancesWithCinderVolumes-262508111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 11:59:47 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-53f1bbd5-4e4f-4fb0-a22a-1a1039e4b6d4 tempest-TestInstancesWithCinderVolumes-262508111 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 11:59:47 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-53f1bbd5-4e4f-4fb0-a22a-1a1039e4b6d4 tempest-TestInstancesWithCinderVolumes-262508111 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 11:59:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-53f1bbd5-4e4f-4fb0-a22a-1a1039e4b6d4 tempest-TestInstancesWithCinderVolumes-262508111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 11:59:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-53f1bbd5-4e4f-4fb0-a22a-1a1039e4b6d4 tempest-TestInstancesWithCinderVolumes-262508111 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 11:59:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-53f1bbd5-4e4f-4fb0-a22a-1a1039e4b6d4 tempest-TestInstancesWithCinderVolumes-262508111 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.084s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 11:59:47 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-53f1bbd5-4e4f-4fb0-a22a-1a1039e4b6d4 tempest-TestInstancesWithCinderVolumes-262508111 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 11:59:47 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-53f1bbd5-4e4f-4fb0-a22a-1a1039e4b6d4 tempest-TestInstancesWithCinderVolumes-262508111 None] Deleted volume successfully.
Sep 18 11:59:47 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-53f1bbd5-4e4f-4fb0-a22a-1a1039e4b6d4 tempest-TestInstancesWithCinderVolumes-262508111 None] Lock "cinder-ae74cbdf-8629-41fc-b1ac-3a3c24db2401-delete_volume" released by "delete_volume" :: held 2.047s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 11:59:57 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=13,cinder:UPDATE=22,cinder:INSERT=6,cinder:DELETE=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 11:59:57 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=11,cinder:INSERT=2,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 12:00:07 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-ca42deaf-30f7-47df-8778-089acaa53579 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:00:07 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca42deaf-30f7-47df-8778-089acaa53579 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 12:00:08 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ca42deaf-30f7-47df-8778-089acaa53579 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Flow 'volume_create_manager' (b7c91ced-33eb-4a56-bd9e-2fcadb227f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:00:08 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ca42deaf-30f7-47df-8778-089acaa53579 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (146f456a-f6b9-4965-b7f1-d5791708e346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:00:08 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ca42deaf-30f7-47df-8778-089acaa53579 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (146f456a-f6b9-4965-b7f1-d5791708e346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1861998768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b63c1e8-9edc-470a-aa0d-e11650de60ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f03af243ab144cd688404c1b7ca257ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:00:08Z,use_quota=True,user_id='a672b3677c534b1c87d9d010ea3d75ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:00:08 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ca42deaf-30f7-47df-8778-089acaa53579 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86d27e37-3c3e-4b49-b79b-e31706748e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:00:08 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ca42deaf-30f7-47df-8778-089acaa53579 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86d27e37-3c3e-4b49-b79b-e31706748e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:00:08 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ca42deaf-30f7-47df-8778-089acaa53579 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85d32c78-3352-4576-987d-0e88770d3604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:00:08 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ca42deaf-30f7-47df-8778-089acaa53579 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85d32c78-3352-4576-987d-0e88770d3604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b63c1e8-9edc-470a-aa0d-e11650de60ac', 'volume_name': 'volume-1b63c1e8-9edc-470a-aa0d-e11650de60ac', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:00:08 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ca42deaf-30f7-47df-8778-089acaa53579 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b75e00b-3d0b-4266-91a4-b6e193061fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:00:08 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ca42deaf-30f7-47df-8778-089acaa53579 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b75e00b-3d0b-4266-91a4-b6e193061fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:00:08 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ca42deaf-30f7-47df-8778-089acaa53579 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cc80722-3232-4de3-954d-c15fdbc5841d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:00:08 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-ca42deaf-30f7-47df-8778-089acaa53579 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Volume 1b63c1e8-9edc-470a-aa0d-e11650de60ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b63c1e8-9edc-470a-aa0d-e11650de60ac', 'volume_size': 1}
Sep 18 12:00:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ca42deaf-30f7-47df-8778-089acaa53579 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:00:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ca42deaf-30f7-47df-8778-089acaa53579 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:00:08 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-ca42deaf-30f7-47df-8778-089acaa53579 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1861998768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b63c1e8-9edc-470a-aa0d-e11650de60ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f03af243ab144cd688404c1b7ca257ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:00:08Z,use_quota=True,user_id='a672b3677c534b1c87d9d010ea3d75ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 12:00:08 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-ca42deaf-30f7-47df-8778-089acaa53579 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Creating volume 1b63c1e8-9edc-470a-aa0d-e11650de60ac {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 12:00:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ca42deaf-30f7-47df-8778-089acaa53579 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:00:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ca42deaf-30f7-47df-8778-089acaa53579 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:00:08 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-ca42deaf-30f7-47df-8778-089acaa53579 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:00:08 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-ca42deaf-30f7-47df-8778-089acaa53579 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:00:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ca42deaf-30f7-47df-8778-089acaa53579 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:00:08 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-ca42deaf-30f7-47df-8778-089acaa53579 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 12:00:08 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-ca42deaf-30f7-47df-8778-089acaa53579 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 12:00:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ca42deaf-30f7-47df-8778-089acaa53579 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1b63c1e8-9edc-470a-aa0d-e11650de60ac 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:00:08 devstack quobyte-client[83193]: System call of process 97191 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 12:00:08 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=124, name=volume-1b63c1e8-9edc-470a-aa0d-e11650de60ac, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:00:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ca42deaf-30f7-47df-8778-089acaa53579 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1b63c1e8-9edc-470a-aa0d-e11650de60ac 1073741824" returned: 0 in 0.414s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:00:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ca42deaf-30f7-47df-8778-089acaa53579 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1b63c1e8-9edc-470a-aa0d-e11650de60ac {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:00:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ca42deaf-30f7-47df-8778-089acaa53579 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1b63c1e8-9edc-470a-aa0d-e11650de60ac" returned: 0 in 0.089s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:00:08 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-ca42deaf-30f7-47df-8778-089acaa53579 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] <== create_volume: return (587ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 12:00:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ca42deaf-30f7-47df-8778-089acaa53579 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.600s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:00:08 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ca42deaf-30f7-47df-8778-089acaa53579 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cc80722-3232-4de3-954d-c15fdbc5841d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b63c1e8-9edc-470a-aa0d-e11650de60ac', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:00:08 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ca42deaf-30f7-47df-8778-089acaa53579 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (204b23cc-a8ab-41a4-9a16-e9712086c9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:00:09 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-ca42deaf-30f7-47df-8778-089acaa53579 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Volume volume-1b63c1e8-9edc-470a-aa0d-e11650de60ac (1b63c1e8-9edc-470a-aa0d-e11650de60ac): created successfully
Sep 18 12:00:09 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ca42deaf-30f7-47df-8778-089acaa53579 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (204b23cc-a8ab-41a4-9a16-e9712086c9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:00:09 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ca42deaf-30f7-47df-8778-089acaa53579 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Flow 'volume_create_manager' (b7c91ced-33eb-4a56-bd9e-2fcadb227f74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:00:09 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-ca42deaf-30f7-47df-8778-089acaa53579 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Created volume successfully.
Sep 18 12:00:10 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-8c79cc43-f2e3-4d8a-acab-1e3672c07f47 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:00:10 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c79cc43-f2e3-4d8a-acab-1e3672c07f47 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 12:00:10 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8c79cc43-f2e3-4d8a-acab-1e3672c07f47 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Flow 'volume_create_manager' (3cb4b413-c414-4da3-a83b-d3af61995be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:00:10 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8c79cc43-f2e3-4d8a-acab-1e3672c07f47 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80d17526-fd16-439e-9ff7-7966057dc19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:00:10 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8c79cc43-f2e3-4d8a-acab-1e3672c07f47 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80d17526-fd16-439e-9ff7-7966057dc19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1702412623',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6744038-91a7-4956-bd89-feeb4568b207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f03af243ab144cd688404c1b7ca257ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:00:10Z,use_quota=True,user_id='a672b3677c534b1c87d9d010ea3d75ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:00:10 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8c79cc43-f2e3-4d8a-acab-1e3672c07f47 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (089269e8-8be2-4416-8e70-b837cae02d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:00:10 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8c79cc43-f2e3-4d8a-acab-1e3672c07f47 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (089269e8-8be2-4416-8e70-b837cae02d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:00:10 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8c79cc43-f2e3-4d8a-acab-1e3672c07f47 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8af25783-9968-414f-ab17-5d730e9d2fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:00:10 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8c79cc43-f2e3-4d8a-acab-1e3672c07f47 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8af25783-9968-414f-ab17-5d730e9d2fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6744038-91a7-4956-bd89-feeb4568b207', 'volume_name': 'volume-d6744038-91a7-4956-bd89-feeb4568b207', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:00:10 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8c79cc43-f2e3-4d8a-acab-1e3672c07f47 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d49ca2e-e655-4e82-8fcb-ba189b7db4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:00:10 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8c79cc43-f2e3-4d8a-acab-1e3672c07f47 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d49ca2e-e655-4e82-8fcb-ba189b7db4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:00:10 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8c79cc43-f2e3-4d8a-acab-1e3672c07f47 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aa5fed3-92f1-4a29-b878-fef38648cc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:00:10 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-8c79cc43-f2e3-4d8a-acab-1e3672c07f47 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Volume d6744038-91a7-4956-bd89-feeb4568b207: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6744038-91a7-4956-bd89-feeb4568b207', 'volume_size': 1}
Sep 18 12:00:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-8c79cc43-f2e3-4d8a-acab-1e3672c07f47 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:00:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-8c79cc43-f2e3-4d8a-acab-1e3672c07f47 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:00:10 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-8c79cc43-f2e3-4d8a-acab-1e3672c07f47 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1702412623',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6744038-91a7-4956-bd89-feeb4568b207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f03af243ab144cd688404c1b7ca257ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:00:10Z,use_quota=True,user_id='a672b3677c534b1c87d9d010ea3d75ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 12:00:10 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-8c79cc43-f2e3-4d8a-acab-1e3672c07f47 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Creating volume d6744038-91a7-4956-bd89-feeb4568b207 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 12:00:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-8c79cc43-f2e3-4d8a-acab-1e3672c07f47 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:00:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-8c79cc43-f2e3-4d8a-acab-1e3672c07f47 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:00:10 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-8c79cc43-f2e3-4d8a-acab-1e3672c07f47 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:00:10 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-8c79cc43-f2e3-4d8a-acab-1e3672c07f47 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:00:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-8c79cc43-f2e3-4d8a-acab-1e3672c07f47 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:00:10 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-8c79cc43-f2e3-4d8a-acab-1e3672c07f47 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 12:00:10 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-8c79cc43-f2e3-4d8a-acab-1e3672c07f47 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 12:00:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8c79cc43-f2e3-4d8a-acab-1e3672c07f47 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d6744038-91a7-4956-bd89-feeb4568b207 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:00:10 devstack quobyte-client[83193]: System call of process 97195 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 12:00:10 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=125, name=volume-d6744038-91a7-4956-bd89-feeb4568b207, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:00:11 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8c79cc43-f2e3-4d8a-acab-1e3672c07f47 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d6744038-91a7-4956-bd89-feeb4568b207 1073741824" returned: 0 in 0.476s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:00:11 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8c79cc43-f2e3-4d8a-acab-1e3672c07f47 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d6744038-91a7-4956-bd89-feeb4568b207 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:00:11 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-7bb54b2d-5d9d-4850-89f8-9df9549cc2a3 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:00:11 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bb54b2d-5d9d-4850-89f8-9df9549cc2a3 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 12:00:11 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-7bb54b2d-5d9d-4850-89f8-9df9549cc2a3 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Flow 'volume_create_manager' (bce2cf8b-56f8-4e24-87de-a79ff34373ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:00:11 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-7bb54b2d-5d9d-4850-89f8-9df9549cc2a3 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcf710e1-133f-49a7-97a4-747752e1fbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:00:11 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8c79cc43-f2e3-4d8a-acab-1e3672c07f47 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d6744038-91a7-4956-bd89-feeb4568b207" returned: 0 in 0.525s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:00:11 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-8c79cc43-f2e3-4d8a-acab-1e3672c07f47 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] <== create_volume: return (1030ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 12:00:11 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-8c79cc43-f2e3-4d8a-acab-1e3672c07f47 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:00:11 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-7bb54b2d-5d9d-4850-89f8-9df9549cc2a3 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcf710e1-133f-49a7-97a4-747752e1fbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-366627443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c044d729-afd6-4b8c-9bde-d6fc73de3c98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f03af243ab144cd688404c1b7ca257ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:00:11Z,use_quota=True,user_id='a672b3677c534b1c87d9d010ea3d75ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:00:11 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-7bb54b2d-5d9d-4850-89f8-9df9549cc2a3 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c40d2195-7c4d-454e-959c-b07d568c503b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:00:11 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-7bb54b2d-5d9d-4850-89f8-9df9549cc2a3 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c40d2195-7c4d-454e-959c-b07d568c503b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:00:11 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-7bb54b2d-5d9d-4850-89f8-9df9549cc2a3 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0637cf53-bd33-41ce-828c-dd4e6467f2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:00:11 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-7bb54b2d-5d9d-4850-89f8-9df9549cc2a3 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0637cf53-bd33-41ce-828c-dd4e6467f2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c044d729-afd6-4b8c-9bde-d6fc73de3c98', 'volume_name': 'volume-c044d729-afd6-4b8c-9bde-d6fc73de3c98', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:00:11 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-7bb54b2d-5d9d-4850-89f8-9df9549cc2a3 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58a17e04-2532-41be-b83b-4a081d127182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:00:11 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-7bb54b2d-5d9d-4850-89f8-9df9549cc2a3 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58a17e04-2532-41be-b83b-4a081d127182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:00:11 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-7bb54b2d-5d9d-4850-89f8-9df9549cc2a3 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a53a1b7a-22ba-4a89-b6bd-676c060b1357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:00:11 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-7bb54b2d-5d9d-4850-89f8-9df9549cc2a3 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Volume c044d729-afd6-4b8c-9bde-d6fc73de3c98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c044d729-afd6-4b8c-9bde-d6fc73de3c98', 'volume_size': 1}
Sep 18 12:00:11 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-7bb54b2d-5d9d-4850-89f8-9df9549cc2a3 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:00:11 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-7bb54b2d-5d9d-4850-89f8-9df9549cc2a3 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:00:11 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-7bb54b2d-5d9d-4850-89f8-9df9549cc2a3 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-366627443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c044d729-afd6-4b8c-9bde-d6fc73de3c98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f03af243ab144cd688404c1b7ca257ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:00:11Z,use_quota=True,user_id='a672b3677c534b1c87d9d010ea3d75ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 12:00:11 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-7bb54b2d-5d9d-4850-89f8-9df9549cc2a3 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Creating volume c044d729-afd6-4b8c-9bde-d6fc73de3c98 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 12:00:11 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-7bb54b2d-5d9d-4850-89f8-9df9549cc2a3 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:00:11 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-7bb54b2d-5d9d-4850-89f8-9df9549cc2a3 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:00:11 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-7bb54b2d-5d9d-4850-89f8-9df9549cc2a3 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:00:11 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-7bb54b2d-5d9d-4850-89f8-9df9549cc2a3 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:00:11 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-7bb54b2d-5d9d-4850-89f8-9df9549cc2a3 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:00:11 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-7bb54b2d-5d9d-4850-89f8-9df9549cc2a3 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 12:00:11 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-7bb54b2d-5d9d-4850-89f8-9df9549cc2a3 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 12:00:11 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7bb54b2d-5d9d-4850-89f8-9df9549cc2a3 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c044d729-afd6-4b8c-9bde-d6fc73de3c98 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:00:11 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=126, name=volume-c044d729-afd6-4b8c-9bde-d6fc73de3c98, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7bb54b2d-5d9d-4850-89f8-9df9549cc2a3 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c044d729-afd6-4b8c-9bde-d6fc73de3c98 1073741824" returned: 0 in 0.530s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7bb54b2d-5d9d-4850-89f8-9df9549cc2a3 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c044d729-afd6-4b8c-9bde-d6fc73de3c98 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:00:12 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-bca45c9b-048c-4169-ba64-35bae9d59bed tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-bca45c9b-048c-4169-ba64-35bae9d59bed tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-bca45c9b-048c-4169-ba64-35bae9d59bed tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Flow 'volume_create_manager' (8413bfdf-c733-4614-a3d8-6ad6c40040fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-bca45c9b-048c-4169-ba64-35bae9d59bed tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb7cd3c2-3e62-4fc1-90f9-c06aa758de9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:00:12 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-ad2d85db-a759-46f2-8ba8-e6f717971ef5 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad2d85db-a759-46f2-8ba8-e6f717971ef5 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ad2d85db-a759-46f2-8ba8-e6f717971ef5 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Flow 'volume_create_manager' (af6a41bb-6084-4ac0-ba65-cd919d3844e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ad2d85db-a759-46f2-8ba8-e6f717971ef5 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebfd45f5-2f96-418a-9bfb-24b789ccaae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8c79cc43-f2e3-4d8a-acab-1e3672c07f47 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aa5fed3-92f1-4a29-b878-fef38648cc73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6744038-91a7-4956-bd89-feeb4568b207', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8c79cc43-f2e3-4d8a-acab-1e3672c07f47 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52f2ebbd-3be8-4509-bab0-6761547cb3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:00:12 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-b8a40c82-7548-45ab-aac3-e8451726b83d tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8a40c82-7548-45ab-aac3-e8451726b83d tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b8a40c82-7548-45ab-aac3-e8451726b83d tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Flow 'volume_create_manager' (56339e2a-e33a-4a37-919f-2860609b06eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b8a40c82-7548-45ab-aac3-e8451726b83d tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3988cd4b-7c39-44f7-bf7c-72dd8a72d259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-bca45c9b-048c-4169-ba64-35bae9d59bed tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb7cd3c2-3e62-4fc1-90f9-c06aa758de9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1476465578',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e519eb2e-db33-4da9-bd6f-81d3e7b526ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f03af243ab144cd688404c1b7ca257ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:00:11Z,use_quota=True,user_id='a672b3677c534b1c87d9d010ea3d75ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-bca45c9b-048c-4169-ba64-35bae9d59bed tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d3a2f0-a892-4e33-9478-d20f5938dad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-bca45c9b-048c-4169-ba64-35bae9d59bed tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d3a2f0-a892-4e33-9478-d20f5938dad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-bca45c9b-048c-4169-ba64-35bae9d59bed tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44c5969a-8693-40ad-a094-9605d812ffee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-bca45c9b-048c-4169-ba64-35bae9d59bed tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44c5969a-8693-40ad-a094-9605d812ffee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e519eb2e-db33-4da9-bd6f-81d3e7b526ca', 'volume_name': 'volume-e519eb2e-db33-4da9-bd6f-81d3e7b526ca', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-bca45c9b-048c-4169-ba64-35bae9d59bed tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11c131ba-dd09-4d2f-a3c0-6943092f52be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-bca45c9b-048c-4169-ba64-35bae9d59bed tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11c131ba-dd09-4d2f-a3c0-6943092f52be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-bca45c9b-048c-4169-ba64-35bae9d59bed tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8446ac47-1cde-450c-b298-91eff19ff0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:00:12 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-bca45c9b-048c-4169-ba64-35bae9d59bed tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Volume e519eb2e-db33-4da9-bd6f-81d3e7b526ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e519eb2e-db33-4da9-bd6f-81d3e7b526ca', 'volume_size': 1}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-bca45c9b-048c-4169-ba64-35bae9d59bed tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b8a40c82-7548-45ab-aac3-e8451726b83d tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3988cd4b-7c39-44f7-bf7c-72dd8a72d259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-975143106',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b4cfb03-cd73-4692-be17-9051e5dfbd8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f03af243ab144cd688404c1b7ca257ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:00:12Z,use_quota=True,user_id='a672b3677c534b1c87d9d010ea3d75ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b8a40c82-7548-45ab-aac3-e8451726b83d tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb3bf154-8dcc-438b-a330-743475258b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b8a40c82-7548-45ab-aac3-e8451726b83d tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb3bf154-8dcc-438b-a330-743475258b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b8a40c82-7548-45ab-aac3-e8451726b83d tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a05fa4e9-df1f-4022-a0be-da1338decac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b8a40c82-7548-45ab-aac3-e8451726b83d tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a05fa4e9-df1f-4022-a0be-da1338decac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b4cfb03-cd73-4692-be17-9051e5dfbd8c', 'volume_name': 'volume-3b4cfb03-cd73-4692-be17-9051e5dfbd8c', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b8a40c82-7548-45ab-aac3-e8451726b83d tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5db130bf-f7a0-44fe-9083-867857082072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b8a40c82-7548-45ab-aac3-e8451726b83d tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5db130bf-f7a0-44fe-9083-867857082072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b8a40c82-7548-45ab-aac3-e8451726b83d tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b84e32d6-c58f-4a21-8a89-a5b90c185e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:00:12 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-b8a40c82-7548-45ab-aac3-e8451726b83d tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Volume 3b4cfb03-cd73-4692-be17-9051e5dfbd8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b4cfb03-cd73-4692-be17-9051e5dfbd8c', 'volume_size': 1}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-b8a40c82-7548-45ab-aac3-e8451726b83d tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7bb54b2d-5d9d-4850-89f8-9df9549cc2a3 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c044d729-afd6-4b8c-9bde-d6fc73de3c98" returned: 0 in 0.646s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-7bb54b2d-5d9d-4850-89f8-9df9549cc2a3 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] <== create_volume: return (1213ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-7bb54b2d-5d9d-4850-89f8-9df9549cc2a3 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ad2d85db-a759-46f2-8ba8-e6f717971ef5 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebfd45f5-2f96-418a-9bfb-24b789ccaae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-522335003',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=968c4ed0-f55b-4b52-bded-d60586b3e112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f03af243ab144cd688404c1b7ca257ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:00:12Z,use_quota=True,user_id='a672b3677c534b1c87d9d010ea3d75ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ad2d85db-a759-46f2-8ba8-e6f717971ef5 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e33d551e-4875-4c23-af5b-30a62e66be46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ad2d85db-a759-46f2-8ba8-e6f717971ef5 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e33d551e-4875-4c23-af5b-30a62e66be46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ad2d85db-a759-46f2-8ba8-e6f717971ef5 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d72133a7-8242-485c-a54e-9fc933d70916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ad2d85db-a759-46f2-8ba8-e6f717971ef5 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d72133a7-8242-485c-a54e-9fc933d70916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '968c4ed0-f55b-4b52-bded-d60586b3e112', 'volume_name': 'volume-968c4ed0-f55b-4b52-bded-d60586b3e112', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ad2d85db-a759-46f2-8ba8-e6f717971ef5 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d123008-3a88-4d78-975a-8bb5c0104258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ad2d85db-a759-46f2-8ba8-e6f717971ef5 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d123008-3a88-4d78-975a-8bb5c0104258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ad2d85db-a759-46f2-8ba8-e6f717971ef5 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2738f22-7a03-41be-991c-98e0c07374c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:00:12 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-ad2d85db-a759-46f2-8ba8-e6f717971ef5 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Volume 968c4ed0-f55b-4b52-bded-d60586b3e112: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-968c4ed0-f55b-4b52-bded-d60586b3e112', 'volume_size': 1}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ad2d85db-a759-46f2-8ba8-e6f717971ef5 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ad2d85db-a759-46f2-8ba8-e6f717971ef5 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-ad2d85db-a759-46f2-8ba8-e6f717971ef5 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-522335003',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=968c4ed0-f55b-4b52-bded-d60586b3e112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f03af243ab144cd688404c1b7ca257ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:00:12Z,use_quota=True,user_id='a672b3677c534b1c87d9d010ea3d75ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-ad2d85db-a759-46f2-8ba8-e6f717971ef5 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Creating volume 968c4ed0-f55b-4b52-bded-d60586b3e112 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ad2d85db-a759-46f2-8ba8-e6f717971ef5 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ad2d85db-a759-46f2-8ba8-e6f717971ef5 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-ad2d85db-a759-46f2-8ba8-e6f717971ef5 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-ad2d85db-a759-46f2-8ba8-e6f717971ef5 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ad2d85db-a759-46f2-8ba8-e6f717971ef5 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-ad2d85db-a759-46f2-8ba8-e6f717971ef5 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 12:00:12 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-ad2d85db-a759-46f2-8ba8-e6f717971ef5 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 12:00:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ad2d85db-a759-46f2-8ba8-e6f717971ef5 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-968c4ed0-f55b-4b52-bded-d60586b3e112 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:00:13 devstack quobyte-client[83193]: System call of process 97203 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 12:00:13 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=127, name=volume-968c4ed0-f55b-4b52-bded-d60586b3e112, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:00:13 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-8c79cc43-f2e3-4d8a-acab-1e3672c07f47 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Volume volume-d6744038-91a7-4956-bd89-feeb4568b207 (d6744038-91a7-4956-bd89-feeb4568b207): created successfully
Sep 18 12:00:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8c79cc43-f2e3-4d8a-acab-1e3672c07f47 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52f2ebbd-3be8-4509-bab0-6761547cb3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:00:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8c79cc43-f2e3-4d8a-acab-1e3672c07f47 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Flow 'volume_create_manager' (3cb4b413-c414-4da3-a83b-d3af61995be7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:00:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ad2d85db-a759-46f2-8ba8-e6f717971ef5 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-968c4ed0-f55b-4b52-bded-d60586b3e112 1073741824" returned: 0 in 0.455s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:00:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ad2d85db-a759-46f2-8ba8-e6f717971ef5 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-968c4ed0-f55b-4b52-bded-d60586b3e112 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:00:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-7bb54b2d-5d9d-4850-89f8-9df9549cc2a3 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a53a1b7a-22ba-4a89-b6bd-676c060b1357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c044d729-afd6-4b8c-9bde-d6fc73de3c98', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:00:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-7bb54b2d-5d9d-4850-89f8-9df9549cc2a3 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ea273d-ba0b-49ff-b696-9c0fe51f7d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:00:13 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-8c79cc43-f2e3-4d8a-acab-1e3672c07f47 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Created volume successfully.
Sep 18 12:00:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-ad2d85db-a759-46f2-8ba8-e6f717971ef5 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-968c4ed0-f55b-4b52-bded-d60586b3e112" returned: 0 in 0.304s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:00:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-ad2d85db-a759-46f2-8ba8-e6f717971ef5 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] <== create_volume: return (777ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 12:00:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-ad2d85db-a759-46f2-8ba8-e6f717971ef5 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:00:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-b8a40c82-7548-45ab-aac3-e8451726b83d tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.851s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:00:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-b8a40c82-7548-45ab-aac3-e8451726b83d tempest-CreateVolumesFromSourceVolumeTest-285048466 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-975143106',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b4cfb03-cd73-4692-be17-9051e5dfbd8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f03af243ab144cd688404c1b7ca257ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:00:12Z,use_quota=True,user_id='a672b3677c534b1c87d9d010ea3d75ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 12:00:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-b8a40c82-7548-45ab-aac3-e8451726b83d tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Creating volume 3b4cfb03-cd73-4692-be17-9051e5dfbd8c {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 12:00:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-b8a40c82-7548-45ab-aac3-e8451726b83d tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:00:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-b8a40c82-7548-45ab-aac3-e8451726b83d tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:00:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-b8a40c82-7548-45ab-aac3-e8451726b83d tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:00:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-b8a40c82-7548-45ab-aac3-e8451726b83d tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:00:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-b8a40c82-7548-45ab-aac3-e8451726b83d tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:00:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-b8a40c82-7548-45ab-aac3-e8451726b83d tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 12:00:13 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-b8a40c82-7548-45ab-aac3-e8451726b83d tempest-CreateVolumesFromSourceVolumeTest-285048466 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 12:00:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b8a40c82-7548-45ab-aac3-e8451726b83d tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-3b4cfb03-cd73-4692-be17-9051e5dfbd8c 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:00:13 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-7bb54b2d-5d9d-4850-89f8-9df9549cc2a3 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Volume volume-c044d729-afd6-4b8c-9bde-d6fc73de3c98 (c044d729-afd6-4b8c-9bde-d6fc73de3c98): created successfully
Sep 18 12:00:13 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=128, name=volume-3b4cfb03-cd73-4692-be17-9051e5dfbd8c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:00:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-7bb54b2d-5d9d-4850-89f8-9df9549cc2a3 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ea273d-ba0b-49ff-b696-9c0fe51f7d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:00:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-7bb54b2d-5d9d-4850-89f8-9df9549cc2a3 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Flow 'volume_create_manager' (bce2cf8b-56f8-4e24-87de-a79ff34373ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:00:14 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 12:00:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:00:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:00:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:00:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:00:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:00:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:00:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ad2d85db-a759-46f2-8ba8-e6f717971ef5 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2738f22-7a03-41be-991c-98e0c07374c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-968c4ed0-f55b-4b52-bded-d60586b3e112', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:00:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ad2d85db-a759-46f2-8ba8-e6f717971ef5 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dacb64ca-4e6e-4b2e-a695-6e9a187f8996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:00:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b8a40c82-7548-45ab-aac3-e8451726b83d tempest-CreateVolumesFromSourceVolumeTest-285048466 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-3b4cfb03-cd73-4692-be17-9051e5dfbd8c 1073741824" returned: 0 in 0.706s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:00:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b8a40c82-7548-45ab-aac3-e8451726b83d tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-3b4cfb03-cd73-4692-be17-9051e5dfbd8c {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:00:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.412s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:00:14 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-7bb54b2d-5d9d-4850-89f8-9df9549cc2a3 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Created volume successfully.
Sep 18 12:00:14 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:00:14 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-ad2d85db-a759-46f2-8ba8-e6f717971ef5 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Volume volume-968c4ed0-f55b-4b52-bded-d60586b3e112 (968c4ed0-f55b-4b52-bded-d60586b3e112): created successfully
Sep 18 12:00:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ad2d85db-a759-46f2-8ba8-e6f717971ef5 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dacb64ca-4e6e-4b2e-a695-6e9a187f8996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:00:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-ad2d85db-a759-46f2-8ba8-e6f717971ef5 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Flow 'volume_create_manager' (af6a41bb-6084-4ac0-ba65-cd919d3844e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:00:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b8a40c82-7548-45ab-aac3-e8451726b83d tempest-CreateVolumesFromSourceVolumeTest-285048466 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-3b4cfb03-cd73-4692-be17-9051e5dfbd8c" returned: 0 in 0.390s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:00:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-b8a40c82-7548-45ab-aac3-e8451726b83d tempest-CreateVolumesFromSourceVolumeTest-285048466 None] <== create_volume: return (1118ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 12:00:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-b8a40c82-7548-45ab-aac3-e8451726b83d tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:00:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-bca45c9b-048c-4169-ba64-35bae9d59bed tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.026s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:00:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-bca45c9b-048c-4169-ba64-35bae9d59bed tempest-CreateVolumesFromSourceVolumeTest-285048466 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1476465578',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e519eb2e-db33-4da9-bd6f-81d3e7b526ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f03af243ab144cd688404c1b7ca257ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:00:11Z,use_quota=True,user_id='a672b3677c534b1c87d9d010ea3d75ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 12:00:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-bca45c9b-048c-4169-ba64-35bae9d59bed tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Creating volume e519eb2e-db33-4da9-bd6f-81d3e7b526ca {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 12:00:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-bca45c9b-048c-4169-ba64-35bae9d59bed tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:00:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-bca45c9b-048c-4169-ba64-35bae9d59bed tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:00:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-bca45c9b-048c-4169-ba64-35bae9d59bed tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:00:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-bca45c9b-048c-4169-ba64-35bae9d59bed tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:00:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-bca45c9b-048c-4169-ba64-35bae9d59bed tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:00:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-bca45c9b-048c-4169-ba64-35bae9d59bed tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 12:00:14 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-bca45c9b-048c-4169-ba64-35bae9d59bed tempest-CreateVolumesFromSourceVolumeTest-285048466 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 12:00:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-bca45c9b-048c-4169-ba64-35bae9d59bed tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e519eb2e-db33-4da9-bd6f-81d3e7b526ca 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:00:15 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-ad2d85db-a759-46f2-8ba8-e6f717971ef5 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Created volume successfully.
Sep 18 12:00:15 devstack quobyte-client[83193]: System call of process 97212 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 12:00:15 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=129, name=volume-e519eb2e-db33-4da9-bd6f-81d3e7b526ca, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:00:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b8a40c82-7548-45ab-aac3-e8451726b83d tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b84e32d6-c58f-4a21-8a89-a5b90c185e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b4cfb03-cd73-4692-be17-9051e5dfbd8c', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:00:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b8a40c82-7548-45ab-aac3-e8451726b83d tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (476bd2fc-92be-429e-bce0-4376325d991a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:00:15 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-b8a40c82-7548-45ab-aac3-e8451726b83d tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Volume volume-3b4cfb03-cd73-4692-be17-9051e5dfbd8c (3b4cfb03-cd73-4692-be17-9051e5dfbd8c): created successfully
Sep 18 12:00:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b8a40c82-7548-45ab-aac3-e8451726b83d tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (476bd2fc-92be-429e-bce0-4376325d991a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:00:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b8a40c82-7548-45ab-aac3-e8451726b83d tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Flow 'volume_create_manager' (56339e2a-e33a-4a37-919f-2860609b06eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:00:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-bca45c9b-048c-4169-ba64-35bae9d59bed tempest-CreateVolumesFromSourceVolumeTest-285048466 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e519eb2e-db33-4da9-bd6f-81d3e7b526ca 1073741824" returned: 0 in 0.413s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:00:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-bca45c9b-048c-4169-ba64-35bae9d59bed tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e519eb2e-db33-4da9-bd6f-81d3e7b526ca {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:00:15 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-b8a40c82-7548-45ab-aac3-e8451726b83d tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Created volume successfully.
Sep 18 12:00:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-bca45c9b-048c-4169-ba64-35bae9d59bed tempest-CreateVolumesFromSourceVolumeTest-285048466 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e519eb2e-db33-4da9-bd6f-81d3e7b526ca" returned: 0 in 0.235s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:00:15 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-bca45c9b-048c-4169-ba64-35bae9d59bed tempest-CreateVolumesFromSourceVolumeTest-285048466 None] <== create_volume: return (672ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 12:00:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-bca45c9b-048c-4169-ba64-35bae9d59bed tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:00:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-bca45c9b-048c-4169-ba64-35bae9d59bed tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8446ac47-1cde-450c-b298-91eff19ff0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e519eb2e-db33-4da9-bd6f-81d3e7b526ca', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:00:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-bca45c9b-048c-4169-ba64-35bae9d59bed tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6594993a-f435-4d62-bae0-7a382d75e008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:00:15 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-bca45c9b-048c-4169-ba64-35bae9d59bed tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Volume volume-e519eb2e-db33-4da9-bd6f-81d3e7b526ca (e519eb2e-db33-4da9-bd6f-81d3e7b526ca): created successfully
Sep 18 12:00:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-bca45c9b-048c-4169-ba64-35bae9d59bed tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6594993a-f435-4d62-bae0-7a382d75e008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:00:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-bca45c9b-048c-4169-ba64-35bae9d59bed tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Flow 'volume_create_manager' (8413bfdf-c733-4614-a3d8-6ad6c40040fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:00:15 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-bca45c9b-048c-4169-ba64-35bae9d59bed tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Created volume successfully.
Sep 18 12:00:17 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-85935079-62ae-4bf1-8c83-07879bb7f312 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Acquiring lock "cinder-968c4ed0-f55b-4b52-bded-d60586b3e112-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:00:17 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-85935079-62ae-4bf1-8c83-07879bb7f312 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "cinder-968c4ed0-f55b-4b52-bded-d60586b3e112-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:00:17 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-85935079-62ae-4bf1-8c83-07879bb7f312 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:00:17 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-85935079-62ae-4bf1-8c83-07879bb7f312 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Acquiring lock "cinder-quobyte-968c4ed0-f55b-4b52-bded-d60586b3e112" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:00:17 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-85935079-62ae-4bf1-8c83-07879bb7f312 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "cinder-quobyte-968c4ed0-f55b-4b52-bded-d60586b3e112" acquired by "delete_volume" :: waited 0.012s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:00:17 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[363266b3-7626-4fed-9a67-4cf1f2d3b28e]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:00:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-85935079-62ae-4bf1-8c83-07879bb7f312 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-968c4ed0-f55b-4b52-bded-d60586b3e112 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:00:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-85935079-62ae-4bf1-8c83-07879bb7f312 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-968c4ed0-f55b-4b52-bded-d60586b3e112" returned: 0 in 0.498s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:00:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-85935079-62ae-4bf1-8c83-07879bb7f312 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-968c4ed0-f55b-4b52-bded-d60586b3e112 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:00:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-85935079-62ae-4bf1-8c83-07879bb7f312 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-968c4ed0-f55b-4b52-bded-d60586b3e112" returned: 0 in 0.144s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:00:18 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-85935079-62ae-4bf1-8c83-07879bb7f312 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "cinder-quobyte-968c4ed0-f55b-4b52-bded-d60586b3e112" released by "delete_volume" :: held 0.861s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:00:18 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-85935079-62ae-4bf1-8c83-07879bb7f312 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Created reservations ['19f4e972-787b-444a-88dd-8f653eb008be', '7d97b479-139d-4349-8be0-4b662ad58ab4', 'bebb8104-040f-42a8-91d4-1ec7b3fe5544', '8a77626b-501c-49d6-bd57-461b6ca51589'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:00:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-85935079-62ae-4bf1-8c83-07879bb7f312 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:00:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-85935079-62ae-4bf1-8c83-07879bb7f312 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:00:18 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-85935079-62ae-4bf1-8c83-07879bb7f312 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:00:18 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-85935079-62ae-4bf1-8c83-07879bb7f312 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:00:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-85935079-62ae-4bf1-8c83-07879bb7f312 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:00:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-85935079-62ae-4bf1-8c83-07879bb7f312 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:00:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-85935079-62ae-4bf1-8c83-07879bb7f312 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.128s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:00:18 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-85935079-62ae-4bf1-8c83-07879bb7f312 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:00:18 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-85935079-62ae-4bf1-8c83-07879bb7f312 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Deleted volume successfully.
Sep 18 12:00:19 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-85935079-62ae-4bf1-8c83-07879bb7f312 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "cinder-968c4ed0-f55b-4b52-bded-d60586b3e112-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:00:19 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-584b8404-12e9-4d4f-b0cc-9c2d05bda8e4 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Acquiring lock "cinder-3b4cfb03-cd73-4692-be17-9051e5dfbd8c-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:00:19 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-584b8404-12e9-4d4f-b0cc-9c2d05bda8e4 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "cinder-3b4cfb03-cd73-4692-be17-9051e5dfbd8c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:00:19 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-584b8404-12e9-4d4f-b0cc-9c2d05bda8e4 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:00:19 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-584b8404-12e9-4d4f-b0cc-9c2d05bda8e4 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Acquiring lock "cinder-quobyte-3b4cfb03-cd73-4692-be17-9051e5dfbd8c" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:00:19 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-584b8404-12e9-4d4f-b0cc-9c2d05bda8e4 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "cinder-quobyte-3b4cfb03-cd73-4692-be17-9051e5dfbd8c" acquired by "delete_volume" :: waited 0.014s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:00:19 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8829f2ab-7b2c-4281-8c93-b6781b626f91]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:00:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-584b8404-12e9-4d4f-b0cc-9c2d05bda8e4 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-3b4cfb03-cd73-4692-be17-9051e5dfbd8c {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:00:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-584b8404-12e9-4d4f-b0cc-9c2d05bda8e4 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-3b4cfb03-cd73-4692-be17-9051e5dfbd8c" returned: 0 in 0.763s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:00:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-584b8404-12e9-4d4f-b0cc-9c2d05bda8e4 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-3b4cfb03-cd73-4692-be17-9051e5dfbd8c {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:00:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-584b8404-12e9-4d4f-b0cc-9c2d05bda8e4 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-3b4cfb03-cd73-4692-be17-9051e5dfbd8c" returned: 0 in 0.242s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:00:21 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-584b8404-12e9-4d4f-b0cc-9c2d05bda8e4 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "cinder-quobyte-3b4cfb03-cd73-4692-be17-9051e5dfbd8c" released by "delete_volume" :: held 1.232s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:00:21 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-584b8404-12e9-4d4f-b0cc-9c2d05bda8e4 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Created reservations ['375cdb98-56cc-48a7-952c-5a3939a28f6b', '8ac19675-a81d-489d-a4fa-614a3ef3a771', 'cf6ec751-3e57-471e-b9fb-9875d46e4232', '92bacf30-d68c-461f-8612-1ad9ac631734'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:00:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-584b8404-12e9-4d4f-b0cc-9c2d05bda8e4 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:00:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-584b8404-12e9-4d4f-b0cc-9c2d05bda8e4 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:00:21 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-584b8404-12e9-4d4f-b0cc-9c2d05bda8e4 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:00:21 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-584b8404-12e9-4d4f-b0cc-9c2d05bda8e4 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:00:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-584b8404-12e9-4d4f-b0cc-9c2d05bda8e4 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:00:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-584b8404-12e9-4d4f-b0cc-9c2d05bda8e4 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:00:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-584b8404-12e9-4d4f-b0cc-9c2d05bda8e4 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.141s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:00:21 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-584b8404-12e9-4d4f-b0cc-9c2d05bda8e4 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:00:22 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-584b8404-12e9-4d4f-b0cc-9c2d05bda8e4 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Deleted volume successfully.
Sep 18 12:00:22 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-dfe162fd-e7b9-493b-8d9c-1b5e2a8db2bb tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Acquiring lock "cinder-e519eb2e-db33-4da9-bd6f-81d3e7b526ca-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:00:22 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-584b8404-12e9-4d4f-b0cc-9c2d05bda8e4 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "cinder-3b4cfb03-cd73-4692-be17-9051e5dfbd8c-delete_volume" released by "delete_volume" :: held 2.668s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:00:22 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-dfe162fd-e7b9-493b-8d9c-1b5e2a8db2bb tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "cinder-e519eb2e-db33-4da9-bd6f-81d3e7b526ca-delete_volume" acquired by "delete_volume" :: waited 0.122s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:00:22 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-dfe162fd-e7b9-493b-8d9c-1b5e2a8db2bb tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:00:22 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-dfe162fd-e7b9-493b-8d9c-1b5e2a8db2bb tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Acquiring lock "cinder-quobyte-e519eb2e-db33-4da9-bd6f-81d3e7b526ca" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:00:22 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-dfe162fd-e7b9-493b-8d9c-1b5e2a8db2bb tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "cinder-quobyte-e519eb2e-db33-4da9-bd6f-81d3e7b526ca" acquired by "delete_volume" :: waited 0.018s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:00:22 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5944717f-e95b-42c6-8bea-c6d46f34a577]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:00:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-dfe162fd-e7b9-493b-8d9c-1b5e2a8db2bb tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e519eb2e-db33-4da9-bd6f-81d3e7b526ca {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:00:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-dfe162fd-e7b9-493b-8d9c-1b5e2a8db2bb tempest-CreateVolumesFromSourceVolumeTest-285048466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e519eb2e-db33-4da9-bd6f-81d3e7b526ca" returned: 0 in 0.599s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:00:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-dfe162fd-e7b9-493b-8d9c-1b5e2a8db2bb tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e519eb2e-db33-4da9-bd6f-81d3e7b526ca {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:00:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-dfe162fd-e7b9-493b-8d9c-1b5e2a8db2bb tempest-CreateVolumesFromSourceVolumeTest-285048466 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e519eb2e-db33-4da9-bd6f-81d3e7b526ca" returned: 0 in 0.105s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:00:23 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-dfe162fd-e7b9-493b-8d9c-1b5e2a8db2bb tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "cinder-quobyte-e519eb2e-db33-4da9-bd6f-81d3e7b526ca" released by "delete_volume" :: held 0.932s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:00:23 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-dfe162fd-e7b9-493b-8d9c-1b5e2a8db2bb tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Created reservations ['1a51cab7-8199-4672-afd3-d4b18789b336', '03af6756-830a-4758-9c60-9096436c0ac5', 'a0986230-3dc3-4d5f-878b-742f08c902a7', '1674917d-ffe8-4b4b-a9a8-04a8fbdf2422'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:00:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-dfe162fd-e7b9-493b-8d9c-1b5e2a8db2bb tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:00:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-dfe162fd-e7b9-493b-8d9c-1b5e2a8db2bb tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:00:23 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-dfe162fd-e7b9-493b-8d9c-1b5e2a8db2bb tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:00:23 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-dfe162fd-e7b9-493b-8d9c-1b5e2a8db2bb tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:00:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-dfe162fd-e7b9-493b-8d9c-1b5e2a8db2bb tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:00:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-dfe162fd-e7b9-493b-8d9c-1b5e2a8db2bb tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:00:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-dfe162fd-e7b9-493b-8d9c-1b5e2a8db2bb tempest-CreateVolumesFromSourceVolumeTest-285048466 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.107s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:00:24 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-dfe162fd-e7b9-493b-8d9c-1b5e2a8db2bb tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:00:24 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-dfe162fd-e7b9-493b-8d9c-1b5e2a8db2bb tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Deleted volume successfully.
Sep 18 12:00:24 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-dfe162fd-e7b9-493b-8d9c-1b5e2a8db2bb tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "cinder-e519eb2e-db33-4da9-bd6f-81d3e7b526ca-delete_volume" released by "delete_volume" :: held 2.009s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:00:24 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0c525459-35fd-46d5-a9ec-6b30e2c57f42 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Acquiring lock "cinder-c044d729-afd6-4b8c-9bde-d6fc73de3c98-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:00:24 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0c525459-35fd-46d5-a9ec-6b30e2c57f42 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "cinder-c044d729-afd6-4b8c-9bde-d6fc73de3c98-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:00:24 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-0c525459-35fd-46d5-a9ec-6b30e2c57f42 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:00:24 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0c525459-35fd-46d5-a9ec-6b30e2c57f42 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Acquiring lock "cinder-quobyte-c044d729-afd6-4b8c-9bde-d6fc73de3c98" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:00:24 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0c525459-35fd-46d5-a9ec-6b30e2c57f42 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "cinder-quobyte-c044d729-afd6-4b8c-9bde-d6fc73de3c98" acquired by "delete_volume" :: waited 0.012s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:00:24 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[61176d6e-facd-42f2-a579-e031714ad213]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:00:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0c525459-35fd-46d5-a9ec-6b30e2c57f42 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c044d729-afd6-4b8c-9bde-d6fc73de3c98 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:00:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0c525459-35fd-46d5-a9ec-6b30e2c57f42 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c044d729-afd6-4b8c-9bde-d6fc73de3c98" returned: 0 in 0.372s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:00:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0c525459-35fd-46d5-a9ec-6b30e2c57f42 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c044d729-afd6-4b8c-9bde-d6fc73de3c98 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:00:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0c525459-35fd-46d5-a9ec-6b30e2c57f42 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c044d729-afd6-4b8c-9bde-d6fc73de3c98" returned: 0 in 0.088s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:00:25 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0c525459-35fd-46d5-a9ec-6b30e2c57f42 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "cinder-quobyte-c044d729-afd6-4b8c-9bde-d6fc73de3c98" released by "delete_volume" :: held 0.610s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:00:25 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-0c525459-35fd-46d5-a9ec-6b30e2c57f42 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Created reservations ['c5d31c01-04c2-4ae7-8420-c9ccc47c2338', '342078be-1896-4fcf-8eb5-536042bf09e8', 'c75d824e-a740-478b-9466-a821aa66373e', '9a392be6-7073-41e6-acba-7e0267daac4b'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:00:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0c525459-35fd-46d5-a9ec-6b30e2c57f42 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:00:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0c525459-35fd-46d5-a9ec-6b30e2c57f42 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:00:25 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-0c525459-35fd-46d5-a9ec-6b30e2c57f42 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:00:25 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-0c525459-35fd-46d5-a9ec-6b30e2c57f42 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:00:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0c525459-35fd-46d5-a9ec-6b30e2c57f42 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:00:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0c525459-35fd-46d5-a9ec-6b30e2c57f42 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:00:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0c525459-35fd-46d5-a9ec-6b30e2c57f42 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.089s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:00:25 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-0c525459-35fd-46d5-a9ec-6b30e2c57f42 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:00:25 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-0c525459-35fd-46d5-a9ec-6b30e2c57f42 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Deleted volume successfully.
Sep 18 12:00:26 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0c525459-35fd-46d5-a9ec-6b30e2c57f42 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "cinder-c044d729-afd6-4b8c-9bde-d6fc73de3c98-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:00:26 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-def20a1c-483d-4972-8ad9-a0c767f9b78c tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Acquiring lock "cinder-d6744038-91a7-4956-bd89-feeb4568b207-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:00:26 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-def20a1c-483d-4972-8ad9-a0c767f9b78c tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "cinder-d6744038-91a7-4956-bd89-feeb4568b207-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:00:26 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-def20a1c-483d-4972-8ad9-a0c767f9b78c tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:00:26 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-def20a1c-483d-4972-8ad9-a0c767f9b78c tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Acquiring lock "cinder-quobyte-d6744038-91a7-4956-bd89-feeb4568b207" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:00:26 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-def20a1c-483d-4972-8ad9-a0c767f9b78c tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "cinder-quobyte-d6744038-91a7-4956-bd89-feeb4568b207" acquired by "delete_volume" :: waited 0.012s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:00:26 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2a6b00-d7cb-4e3c-be83-b770bd8b7d21]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:00:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-def20a1c-483d-4972-8ad9-a0c767f9b78c tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d6744038-91a7-4956-bd89-feeb4568b207 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:00:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-def20a1c-483d-4972-8ad9-a0c767f9b78c tempest-CreateVolumesFromSourceVolumeTest-285048466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d6744038-91a7-4956-bd89-feeb4568b207" returned: 0 in 0.400s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:00:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-def20a1c-483d-4972-8ad9-a0c767f9b78c tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d6744038-91a7-4956-bd89-feeb4568b207 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:00:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-def20a1c-483d-4972-8ad9-a0c767f9b78c tempest-CreateVolumesFromSourceVolumeTest-285048466 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d6744038-91a7-4956-bd89-feeb4568b207" returned: 0 in 0.112s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:00:27 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-def20a1c-483d-4972-8ad9-a0c767f9b78c tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "cinder-quobyte-d6744038-91a7-4956-bd89-feeb4568b207" released by "delete_volume" :: held 0.647s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:00:27 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-def20a1c-483d-4972-8ad9-a0c767f9b78c tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Created reservations ['e082e6c7-f41b-4f69-880d-82f4ebb1fa52', '206dce54-57f5-4607-b8c6-c666299cd158', 'bef5e84f-04b6-4bee-b644-e2aa3907c84b', 'eae5a564-de66-4e8e-b03f-8ac63e818778'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:00:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-def20a1c-483d-4972-8ad9-a0c767f9b78c tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:00:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-def20a1c-483d-4972-8ad9-a0c767f9b78c tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:00:27 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-def20a1c-483d-4972-8ad9-a0c767f9b78c tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:00:27 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-def20a1c-483d-4972-8ad9-a0c767f9b78c tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:00:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-def20a1c-483d-4972-8ad9-a0c767f9b78c tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:00:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-def20a1c-483d-4972-8ad9-a0c767f9b78c tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:00:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-def20a1c-483d-4972-8ad9-a0c767f9b78c tempest-CreateVolumesFromSourceVolumeTest-285048466 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.109s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:00:28 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-def20a1c-483d-4972-8ad9-a0c767f9b78c tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:00:28 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-def20a1c-483d-4972-8ad9-a0c767f9b78c tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Deleted volume successfully.
Sep 18 12:00:28 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-def20a1c-483d-4972-8ad9-a0c767f9b78c tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "cinder-d6744038-91a7-4956-bd89-feeb4568b207-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:00:28 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-052a0aeb-fc67-43bf-bd47-347a2ff3ddc4 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Acquiring lock "cinder-1b63c1e8-9edc-470a-aa0d-e11650de60ac-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:00:29 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-052a0aeb-fc67-43bf-bd47-347a2ff3ddc4 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "cinder-1b63c1e8-9edc-470a-aa0d-e11650de60ac-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:00:29 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-052a0aeb-fc67-43bf-bd47-347a2ff3ddc4 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:00:29 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-052a0aeb-fc67-43bf-bd47-347a2ff3ddc4 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Acquiring lock "cinder-quobyte-1b63c1e8-9edc-470a-aa0d-e11650de60ac" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:00:29 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-052a0aeb-fc67-43bf-bd47-347a2ff3ddc4 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "cinder-quobyte-1b63c1e8-9edc-470a-aa0d-e11650de60ac" acquired by "delete_volume" :: waited 0.011s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:00:29 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b4a208-d070-40b7-a0d2-78713c158485]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:00:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-052a0aeb-fc67-43bf-bd47-347a2ff3ddc4 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1b63c1e8-9edc-470a-aa0d-e11650de60ac {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:00:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-052a0aeb-fc67-43bf-bd47-347a2ff3ddc4 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1b63c1e8-9edc-470a-aa0d-e11650de60ac" returned: 0 in 0.405s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:00:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-052a0aeb-fc67-43bf-bd47-347a2ff3ddc4 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1b63c1e8-9edc-470a-aa0d-e11650de60ac {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:00:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-052a0aeb-fc67-43bf-bd47-347a2ff3ddc4 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1b63c1e8-9edc-470a-aa0d-e11650de60ac" returned: 0 in 0.107s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:00:29 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-052a0aeb-fc67-43bf-bd47-347a2ff3ddc4 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "cinder-quobyte-1b63c1e8-9edc-470a-aa0d-e11650de60ac" released by "delete_volume" :: held 0.641s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:00:30 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-052a0aeb-fc67-43bf-bd47-347a2ff3ddc4 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Created reservations ['8ef15327-b007-41e5-8cf8-4bb880f0adfd', '8998b0fd-c3ab-41af-95f0-9a014179e5e0', 'c9c387f8-f430-4129-a371-996434fd0806', '051b91d8-1f55-49b0-953c-71c3e66d423d'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:00:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-052a0aeb-fc67-43bf-bd47-347a2ff3ddc4 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:00:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-052a0aeb-fc67-43bf-bd47-347a2ff3ddc4 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:00:30 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-052a0aeb-fc67-43bf-bd47-347a2ff3ddc4 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:00:30 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-052a0aeb-fc67-43bf-bd47-347a2ff3ddc4 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:00:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-052a0aeb-fc67-43bf-bd47-347a2ff3ddc4 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:00:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-052a0aeb-fc67-43bf-bd47-347a2ff3ddc4 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:00:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-052a0aeb-fc67-43bf-bd47-347a2ff3ddc4 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.121s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:00:30 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-052a0aeb-fc67-43bf-bd47-347a2ff3ddc4 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:00:30 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-052a0aeb-fc67-43bf-bd47-347a2ff3ddc4 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Deleted volume successfully.
Sep 18 12:00:30 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-052a0aeb-fc67-43bf-bd47-347a2ff3ddc4 tempest-CreateVolumesFromSourceVolumeTest-285048466 None] Lock "cinder-1b63c1e8-9edc-470a-aa0d-e11650de60ac-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:00:43 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:UPDATE=63,cinder:SELECT=39,cinder:DELETE=7,cinder:INSERT=8 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 12:00:43 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=34,cinder:UPDATE=58,cinder:DELETE=5,cinder:INSERT=16 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 12:00:44 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-efaed876-a9cc-4c3c-b89d-c01e1521b80c req-d9b29c7a-40c3-4a6a-85c7-a319282fb21f tempest-TestMinimumBasicScenario-586190042 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:00:44 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-efaed876-a9cc-4c3c-b89d-c01e1521b80c req-d9b29c7a-40c3-4a6a-85c7-a319282fb21f tempest-TestMinimumBasicScenario-586190042 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:00:44 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-efaed876-a9cc-4c3c-b89d-c01e1521b80c req-d9b29c7a-40c3-4a6a-85c7-a319282fb21f tempest-TestMinimumBasicScenario-586190042 None] Terminate volume connection completed successfully.
Sep 18 12:00:44 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-efaed876-a9cc-4c3c-b89d-c01e1521b80c req-d9b29c7a-40c3-4a6a-85c7-a319282fb21f tempest-TestMinimumBasicScenario-586190042 None] Deleting attachment 9a4bd780-f86d-4fa7-8665-e666335231bc. {{(pid=83176) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 12:00:46 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-fa74ea33-c498-489f-977e-ff6b633892b6 tempest-TestMinimumBasicScenario-586190042 None] Acquiring lock "cinder-0bcedc01-ecc8-4b30-b202-15c6020f53bf-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:00:46 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-fa74ea33-c498-489f-977e-ff6b633892b6 tempest-TestMinimumBasicScenario-586190042 None] Lock "cinder-0bcedc01-ecc8-4b30-b202-15c6020f53bf-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:00:46 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-fa74ea33-c498-489f-977e-ff6b633892b6 tempest-TestMinimumBasicScenario-586190042 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:00:46 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-fa74ea33-c498-489f-977e-ff6b633892b6 tempest-TestMinimumBasicScenario-586190042 None] Acquiring lock "cinder-quobyte-0bcedc01-ecc8-4b30-b202-15c6020f53bf" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:00:46 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-fa74ea33-c498-489f-977e-ff6b633892b6 tempest-TestMinimumBasicScenario-586190042 None] Lock "cinder-quobyte-0bcedc01-ecc8-4b30-b202-15c6020f53bf" acquired by "delete_volume" :: waited 0.014s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:00:46 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d4e456-68f6-44f2-a8c6-7f67723efc1e]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:00:46 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fa74ea33-c498-489f-977e-ff6b633892b6 tempest-TestMinimumBasicScenario-586190042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-0bcedc01-ecc8-4b30-b202-15c6020f53bf {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:00:46 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fa74ea33-c498-489f-977e-ff6b633892b6 tempest-TestMinimumBasicScenario-586190042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-0bcedc01-ecc8-4b30-b202-15c6020f53bf" returned: 0 in 0.487s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:00:46 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fa74ea33-c498-489f-977e-ff6b633892b6 tempest-TestMinimumBasicScenario-586190042 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-0bcedc01-ecc8-4b30-b202-15c6020f53bf {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:00:46 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fa74ea33-c498-489f-977e-ff6b633892b6 tempest-TestMinimumBasicScenario-586190042 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-0bcedc01-ecc8-4b30-b202-15c6020f53bf" returned: 0 in 0.098s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:00:46 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-fa74ea33-c498-489f-977e-ff6b633892b6 tempest-TestMinimumBasicScenario-586190042 None] Lock "cinder-quobyte-0bcedc01-ecc8-4b30-b202-15c6020f53bf" released by "delete_volume" :: held 0.773s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:00:47 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-fa74ea33-c498-489f-977e-ff6b633892b6 tempest-TestMinimumBasicScenario-586190042 None] Created reservations ['b3d105b7-2e74-42c8-8477-cf9ead3cf280', '4c2b4f45-7171-4d31-94ba-3a7285cf4286', '1e499492-f004-4c14-b442-2c742e5c7f1e', 'aef77bcb-2bf6-461d-93ae-59bb811709b6'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:00:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-fa74ea33-c498-489f-977e-ff6b633892b6 tempest-TestMinimumBasicScenario-586190042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:00:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-fa74ea33-c498-489f-977e-ff6b633892b6 tempest-TestMinimumBasicScenario-586190042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:00:47 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-fa74ea33-c498-489f-977e-ff6b633892b6 tempest-TestMinimumBasicScenario-586190042 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:00:47 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-fa74ea33-c498-489f-977e-ff6b633892b6 tempest-TestMinimumBasicScenario-586190042 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:00:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-fa74ea33-c498-489f-977e-ff6b633892b6 tempest-TestMinimumBasicScenario-586190042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:00:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fa74ea33-c498-489f-977e-ff6b633892b6 tempest-TestMinimumBasicScenario-586190042 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:00:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fa74ea33-c498-489f-977e-ff6b633892b6 tempest-TestMinimumBasicScenario-586190042 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.135s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:00:47 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-fa74ea33-c498-489f-977e-ff6b633892b6 tempest-TestMinimumBasicScenario-586190042 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:00:47 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-fa74ea33-c498-489f-977e-ff6b633892b6 tempest-TestMinimumBasicScenario-586190042 None] Deleted volume successfully.
Sep 18 12:00:47 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-fa74ea33-c498-489f-977e-ff6b633892b6 tempest-TestMinimumBasicScenario-586190042 None] Lock "cinder-0bcedc01-ecc8-4b30-b202-15c6020f53bf-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:00:57 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-e5d82629-4b65-4aaa-8021-174895bb46f6 tempest-SnapshotDependencyTests-1724648070 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:00:57 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5d82629-4b65-4aaa-8021-174895bb46f6 tempest-SnapshotDependencyTests-1724648070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 12:00:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-e5d82629-4b65-4aaa-8021-174895bb46f6 tempest-SnapshotDependencyTests-1724648070 None] Flow 'volume_create_manager' (003f1acb-df19-48bb-8dfa-8515eab1173b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:00:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-e5d82629-4b65-4aaa-8021-174895bb46f6 tempest-SnapshotDependencyTests-1724648070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e0146c2-2b05-4212-95b5-b5589ec9c381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:00:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-e5d82629-4b65-4aaa-8021-174895bb46f6 tempest-SnapshotDependencyTests-1724648070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e0146c2-2b05-4212-95b5-b5589ec9c381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-793705974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87f06b73-d040-464c-b284-e10e8797a2ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50694998cede4db09523df9e956da697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:00:57Z,use_quota=True,user_id='4e6ea9699383426c8cbd445af8d10f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:00:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-e5d82629-4b65-4aaa-8021-174895bb46f6 tempest-SnapshotDependencyTests-1724648070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79982066-25a6-419e-a9b2-ab7162722026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:00:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-e5d82629-4b65-4aaa-8021-174895bb46f6 tempest-SnapshotDependencyTests-1724648070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79982066-25a6-419e-a9b2-ab7162722026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:00:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-e5d82629-4b65-4aaa-8021-174895bb46f6 tempest-SnapshotDependencyTests-1724648070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b7429a1-ae85-4f3f-b13f-2c0e73a1ff38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:00:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-e5d82629-4b65-4aaa-8021-174895bb46f6 tempest-SnapshotDependencyTests-1724648070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b7429a1-ae85-4f3f-b13f-2c0e73a1ff38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87f06b73-d040-464c-b284-e10e8797a2ee', 'volume_name': 'volume-87f06b73-d040-464c-b284-e10e8797a2ee', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:00:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-e5d82629-4b65-4aaa-8021-174895bb46f6 tempest-SnapshotDependencyTests-1724648070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c69786c0-d0d1-418d-88fb-e737e7ea8a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:00:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-e5d82629-4b65-4aaa-8021-174895bb46f6 tempest-SnapshotDependencyTests-1724648070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c69786c0-d0d1-418d-88fb-e737e7ea8a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:00:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-e5d82629-4b65-4aaa-8021-174895bb46f6 tempest-SnapshotDependencyTests-1724648070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfc12c76-fac4-4170-9935-ac25c9d573a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:00:57 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-e5d82629-4b65-4aaa-8021-174895bb46f6 tempest-SnapshotDependencyTests-1724648070 None] Volume 87f06b73-d040-464c-b284-e10e8797a2ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87f06b73-d040-464c-b284-e10e8797a2ee', 'volume_size': 1}
Sep 18 12:00:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-e5d82629-4b65-4aaa-8021-174895bb46f6 tempest-SnapshotDependencyTests-1724648070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:00:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-e5d82629-4b65-4aaa-8021-174895bb46f6 tempest-SnapshotDependencyTests-1724648070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:00:57 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-e5d82629-4b65-4aaa-8021-174895bb46f6 tempest-SnapshotDependencyTests-1724648070 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-793705974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87f06b73-d040-464c-b284-e10e8797a2ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50694998cede4db09523df9e956da697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:00:57Z,use_quota=True,user_id='4e6ea9699383426c8cbd445af8d10f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 12:00:57 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-e5d82629-4b65-4aaa-8021-174895bb46f6 tempest-SnapshotDependencyTests-1724648070 None] Creating volume 87f06b73-d040-464c-b284-e10e8797a2ee {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 12:00:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-e5d82629-4b65-4aaa-8021-174895bb46f6 tempest-SnapshotDependencyTests-1724648070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:00:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-e5d82629-4b65-4aaa-8021-174895bb46f6 tempest-SnapshotDependencyTests-1724648070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:00:57 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-e5d82629-4b65-4aaa-8021-174895bb46f6 tempest-SnapshotDependencyTests-1724648070 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:00:57 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-e5d82629-4b65-4aaa-8021-174895bb46f6 tempest-SnapshotDependencyTests-1724648070 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:00:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-e5d82629-4b65-4aaa-8021-174895bb46f6 tempest-SnapshotDependencyTests-1724648070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:00:57 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-e5d82629-4b65-4aaa-8021-174895bb46f6 tempest-SnapshotDependencyTests-1724648070 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 12:00:57 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-e5d82629-4b65-4aaa-8021-174895bb46f6 tempest-SnapshotDependencyTests-1724648070 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 12:00:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-e5d82629-4b65-4aaa-8021-174895bb46f6 tempest-SnapshotDependencyTests-1724648070 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:00:57 devstack quobyte-client[83193]: System call of process 97369 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 12:00:57 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=130, name=volume-87f06b73-d040-464c-b284-e10e8797a2ee, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:00:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-e5d82629-4b65-4aaa-8021-174895bb46f6 tempest-SnapshotDependencyTests-1724648070 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee 1073741824" returned: 0 in 0.352s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:00:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-e5d82629-4b65-4aaa-8021-174895bb46f6 tempest-SnapshotDependencyTests-1724648070 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:00:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-e5d82629-4b65-4aaa-8021-174895bb46f6 tempest-SnapshotDependencyTests-1724648070 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee" returned: 0 in 0.132s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:00:58 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-e5d82629-4b65-4aaa-8021-174895bb46f6 tempest-SnapshotDependencyTests-1724648070 None] <== create_volume: return (595ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 12:00:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-e5d82629-4b65-4aaa-8021-174895bb46f6 tempest-SnapshotDependencyTests-1724648070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.606s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:00:58 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-e5d82629-4b65-4aaa-8021-174895bb46f6 tempest-SnapshotDependencyTests-1724648070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfc12c76-fac4-4170-9935-ac25c9d573a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87f06b73-d040-464c-b284-e10e8797a2ee', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:00:58 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-e5d82629-4b65-4aaa-8021-174895bb46f6 tempest-SnapshotDependencyTests-1724648070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (713f943b-e165-4f2a-a863-9227a2c0fb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:00:58 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-e5d82629-4b65-4aaa-8021-174895bb46f6 tempest-SnapshotDependencyTests-1724648070 None] Volume volume-87f06b73-d040-464c-b284-e10e8797a2ee (87f06b73-d040-464c-b284-e10e8797a2ee): created successfully
Sep 18 12:00:58 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-e5d82629-4b65-4aaa-8021-174895bb46f6 tempest-SnapshotDependencyTests-1724648070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (713f943b-e165-4f2a-a863-9227a2c0fb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:00:58 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-e5d82629-4b65-4aaa-8021-174895bb46f6 tempest-SnapshotDependencyTests-1724648070 None] Flow 'volume_create_manager' (003f1acb-df19-48bb-8dfa-8515eab1173b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:00:58 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-e5d82629-4b65-4aaa-8021-174895bb46f6 tempest-SnapshotDependencyTests-1724648070 None] Created volume successfully.
Sep 18 12:00:59 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-371f865e-df21-499d-9e71-bbaf9e97f3b8 tempest-SnapshotDependencyTests-1724648070 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:00:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-371f865e-df21-499d-9e71-bbaf9e97f3b8 tempest-SnapshotDependencyTests-1724648070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:00:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-371f865e-df21-499d-9e71-bbaf9e97f3b8 tempest-SnapshotDependencyTests-1724648070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:00:59 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-371f865e-df21-499d-9e71-bbaf9e97f3b8 tempest-SnapshotDependencyTests-1724648070 None] Creating offline snapshot 7691ec88-5247-41ff-996b-5311bbd23d34 of volume 87f06b73-d040-464c-b284-e10e8797a2ee {{(pid=83176) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 12:00:59 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[de762467-c43c-42e5-b40b-272ec06a3729]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:00:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-371f865e-df21-499d-9e71-bbaf9e97f3b8 tempest-SnapshotDependencyTests-1724648070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:01:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-371f865e-df21-499d-9e71-bbaf9e97f3b8 tempest-SnapshotDependencyTests-1724648070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee" returned: 0 in 0.596s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:01:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-371f865e-df21-499d-9e71-bbaf9e97f3b8 tempest-SnapshotDependencyTests-1724648070 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee.7691ec88-5247-41ff-996b-5311bbd23d34 1G {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:01:00 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=131, name=volume-87f06b73-d040-464c-b284-e10e8797a2ee.7691ec88-5247-41ff-996b-5311bbd23d34, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:01:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-371f865e-df21-499d-9e71-bbaf9e97f3b8 tempest-SnapshotDependencyTests-1724648070 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee.7691ec88-5247-41ff-996b-5311bbd23d34 1G" returned: 0 in 0.395s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:01:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-371f865e-df21-499d-9e71-bbaf9e97f3b8 tempest-SnapshotDependencyTests-1724648070 None] Running cmd (subprocess): qemu-img rebase -u -b volume-87f06b73-d040-464c-b284-e10e8797a2ee -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee.7691ec88-5247-41ff-996b-5311bbd23d34 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:01:01 devstack quobyte-client[83193]: System call of process 97380 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 12:01:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-371f865e-df21-499d-9e71-bbaf9e97f3b8 tempest-SnapshotDependencyTests-1724648070 None] CMD "qemu-img rebase -u -b volume-87f06b73-d040-464c-b284-e10e8797a2ee -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee.7691ec88-5247-41ff-996b-5311bbd23d34" returned: 0 in 0.260s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:01:01 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-371f865e-df21-499d-9e71-bbaf9e97f3b8 tempest-SnapshotDependencyTests-1724648070 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee.7691ec88-5247-41ff-996b-5311bbd23d34 is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 12:01:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-371f865e-df21-499d-9e71-bbaf9e97f3b8 tempest-SnapshotDependencyTests-1724648070 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee.7691ec88-5247-41ff-996b-5311bbd23d34 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:01:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-371f865e-df21-499d-9e71-bbaf9e97f3b8 tempest-SnapshotDependencyTests-1724648070 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee.7691ec88-5247-41ff-996b-5311bbd23d34" returned: 0 in 0.178s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:01:01 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-371f865e-df21-499d-9e71-bbaf9e97f3b8 tempest-SnapshotDependencyTests-1724648070 None] Setting permissions: /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee -> 1000:1000 {{(pid=83176) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 12:01:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-371f865e-df21-499d-9e71-bbaf9e97f3b8 tempest-SnapshotDependencyTests-1724648070 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee.7691ec88-5247-41ff-996b-5311bbd23d34 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:01:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-371f865e-df21-499d-9e71-bbaf9e97f3b8 tempest-SnapshotDependencyTests-1724648070 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee.7691ec88-5247-41ff-996b-5311bbd23d34" returned: 0 in 0.185s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:01:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-371f865e-df21-499d-9e71-bbaf9e97f3b8 tempest-SnapshotDependencyTests-1724648070 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee.info {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:01:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-371f865e-df21-499d-9e71-bbaf9e97f3b8 tempest-SnapshotDependencyTests-1724648070 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee.info" returned: 0 in 0.208s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:01:02 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-371f865e-df21-499d-9e71-bbaf9e97f3b8 tempest-SnapshotDependencyTests-1724648070 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee.info is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 12:01:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-371f865e-df21-499d-9e71-bbaf9e97f3b8 tempest-SnapshotDependencyTests-1724648070 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee.info {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:01:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-371f865e-df21-499d-9e71-bbaf9e97f3b8 tempest-SnapshotDependencyTests-1724648070 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee.info" returned: 0 in 0.101s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:01:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-371f865e-df21-499d-9e71-bbaf9e97f3b8 tempest-SnapshotDependencyTests-1724648070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.462s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:01:02 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-371f865e-df21-499d-9e71-bbaf9e97f3b8 tempest-SnapshotDependencyTests-1724648070 None] Create snapshot completed successfully
Sep 18 12:01:03 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:01:03 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 12:01:03 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Flow 'volume_create_manager' (64b3e147-ce3f-4703-b756-ff03a7920029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:01:03 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60b17358-b692-476d-a6c4-0fc7b2c05f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:01:03 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60b17358-b692-476d-a6c4-0fc7b2c05f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:01:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48ad8502-2877-4136-992a-12ec5f113dec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50694998cede4db09523df9e956da697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:01:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7691ec88-5247-41ff-996b-5311bbd23d34,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:01:03Z,use_quota=True,user_id='4e6ea9699383426c8cbd445af8d10f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:01:03 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40eafe94-720d-47ca-a75a-024c242ec05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:01:03 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40eafe94-720d-47ca-a75a-024c242ec05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:01:03 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a783054c-f733-49cf-be4d-278ed90db1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:01:03 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a783054c-f733-49cf-be4d-278ed90db1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '48ad8502-2877-4136-992a-12ec5f113dec', 'volume_name': 'volume-48ad8502-2877-4136-992a-12ec5f113dec', 'volume_size': 1, 'snapshot_id': '7691ec88-5247-41ff-996b-5311bbd23d34'}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:01:03 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7ef6f8f-87fc-446d-84ec-a7a82e50f750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:01:03 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7ef6f8f-87fc-446d-84ec-a7a82e50f750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:01:03 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cbefac3-fdf4-4bba-a508-59f07e1b7b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:01:04 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Volume 48ad8502-2877-4136-992a-12ec5f113dec: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-48ad8502-2877-4136-992a-12ec5f113dec', 'volume_size': 1, 'snapshot_id': '7691ec88-5247-41ff-996b-5311bbd23d34'}
Sep 18 12:01:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:01:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:01:04 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Acquiring lock "cinder-quobyte-7691ec88-5247-41ff-996b-5311bbd23d34-48ad8502-2877-4136-992a-12ec5f113dec" by "_create_volume_from_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:01:04 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Lock "cinder-quobyte-7691ec88-5247-41ff-996b-5311bbd23d34-48ad8502-2877-4136-992a-12ec5f113dec" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:01:04 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Creating volume 48ad8502-2877-4136-992a-12ec5f113dec from snapshot 7691ec88-5247-41ff-996b-5311bbd23d34 {{(pid=83176) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 18 12:01:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:01:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:01:04 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:01:04 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:01:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:01:04 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 12:01:04 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Acquiring lock "cinder-quobyte-48ad8502-2877-4136-992a-12ec5f113dec" by "_copy_volume_from_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:01:04 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Lock "cinder-quobyte-48ad8502-2877-4136-992a-12ec5f113dec" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:01:04 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] snapshot: 7691ec88-5247-41ff-996b-5311bbd23d34, volume: 48ad8502-2877-4136-992a-12ec5f113dec,  {{(pid=83176) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 18 12:01:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:01:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:01:04 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:01:04 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:01:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:01:04 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f57e47-02c1-4b69-9dc1-4ae7e6dd52a3]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:01:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee.7691ec88-5247-41ff-996b-5311bbd23d34 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:01:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee.7691ec88-5247-41ff-996b-5311bbd23d34" returned: 0 in 0.547s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:01:04 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87f06b73-d040-464c-b284-e10e8797a2ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 12:01:04 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] will copy from snapshot at /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee {{(pid=83176) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 18 12:01:04 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Creating direct copy from snapshot {{(pid=83176) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 18 12:01:04 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47f415e-6bc2-4cf0-bf73-c55190dc5015]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:01:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:01:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee" returned: 0 in 0.600s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:01:05 devstack cinder-volume[83176]: DEBUG cinder.utils [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-48ad8502-2877-4136-992a-12ec5f113dec not found in is_blk_device check {{(pid=83176) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 18 12:01:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-48ad8502-2877-4136-992a-12ec5f113dec {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:01:05 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=133, name=volume-48ad8502-2877-4136-992a-12ec5f113dec, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:01:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-48ad8502-2877-4136-992a-12ec5f113dec" returned: 0 in 6.501s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:01:12 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc022376-e074-4115-b9e1-9cbf01bb2013]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:01:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:01:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee" returned: 0 in 0.693s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:01:12 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Image conversion details: src /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee, size 1024.00 MB, duration 6.53 sec, destination /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-48ad8502-2877-4136-992a-12ec5f113dec {{(pid=83176) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 12:01:12 devstack cinder-volume[83176]: INFO cinder.image.image_utils [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Converted 1024.00 MB image at 156.71 MB/s
Sep 18 12:01:12 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-48ad8502-2877-4136-992a-12ec5f113dec is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 12:01:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-48ad8502-2877-4136-992a-12ec5f113dec {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:01:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-48ad8502-2877-4136-992a-12ec5f113dec" returned: 0 in 0.232s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:01:13 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Lock "cinder-quobyte-48ad8502-2877-4136-992a-12ec5f113dec" released by "_copy_volume_from_snapshot" :: held 9.066s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:01:13 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Lock "cinder-quobyte-7691ec88-5247-41ff-996b-5311bbd23d34-48ad8502-2877-4136-992a-12ec5f113dec" released by "_create_volume_from_snapshot" :: held 9.120s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:01:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.144s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:01:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cbefac3-fdf4-4bba-a508-59f07e1b7b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48ad8502-2877-4136-992a-12ec5f113dec', 'volume_size': 1, 'snapshot_id': '7691ec88-5247-41ff-996b-5311bbd23d34'}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:01:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7caef65c-8b5d-4306-941b-3f2e57c7a169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:01:13 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Volume volume-48ad8502-2877-4136-992a-12ec5f113dec (48ad8502-2877-4136-992a-12ec5f113dec): created successfully
Sep 18 12:01:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7caef65c-8b5d-4306-941b-3f2e57c7a169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:01:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Flow 'volume_create_manager' (64b3e147-ce3f-4703-b756-ff03a7920029) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:01:13 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-9a662377-44cc-41c2-a9f6-13134416c605 tempest-SnapshotDependencyTests-1724648070 None] Created volume successfully.
Sep 18 12:01:14 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 12:01:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:01:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:01:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:01:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:01:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:01:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:01:14 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-8a3d6b2c-820f-4e71-a4e5-1aa5668b3c59 tempest-SnapshotDependencyTests-1724648070 None] Acquiring lock "cinder-7691ec88-5247-41ff-996b-5311bbd23d34-delete_snapshot" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:01:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.313s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:01:14 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:01:14 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-8a3d6b2c-820f-4e71-a4e5-1aa5668b3c59 tempest-SnapshotDependencyTests-1724648070 None] Lock "cinder-7691ec88-5247-41ff-996b-5311bbd23d34-delete_snapshot" acquired by "delete_snapshot" :: waited 0.231s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:01:14 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-8a3d6b2c-820f-4e71-a4e5-1aa5668b3c59 tempest-SnapshotDependencyTests-1724648070 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:01:14 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-8a3d6b2c-820f-4e71-a4e5-1aa5668b3c59 tempest-SnapshotDependencyTests-1724648070 None] Acquiring lock "cinder-quobyte-87f06b73-d040-464c-b284-e10e8797a2ee" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:01:14 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-8a3d6b2c-820f-4e71-a4e5-1aa5668b3c59 tempest-SnapshotDependencyTests-1724648070 None] Lock "cinder-quobyte-87f06b73-d040-464c-b284-e10e8797a2ee" acquired by "delete_snapshot" :: waited 0.028s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:01:14 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-8a3d6b2c-820f-4e71-a4e5-1aa5668b3c59 tempest-SnapshotDependencyTests-1724648070 None] Acquiring lock "cinder-quobyte-7691ec88-5247-41ff-996b-5311bbd23d34" by "_delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:01:14 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-8a3d6b2c-820f-4e71-a4e5-1aa5668b3c59 tempest-SnapshotDependencyTests-1724648070 None] Lock "cinder-quobyte-7691ec88-5247-41ff-996b-5311bbd23d34" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:01:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-8a3d6b2c-820f-4e71-a4e5-1aa5668b3c59 tempest-SnapshotDependencyTests-1724648070 None] Deleting offline snapshot 7691ec88-5247-41ff-996b-5311bbd23d34 of volume 87f06b73-d040-464c-b284-e10e8797a2ee {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 12:01:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-8a3d6b2c-820f-4e71-a4e5-1aa5668b3c59 tempest-SnapshotDependencyTests-1724648070 None] snapshot_file for this snap is: volume-87f06b73-d040-464c-b284-e10e8797a2ee.7691ec88-5247-41ff-996b-5311bbd23d34 {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 12:01:14 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e15852b-d82b-4d4b-8458-e31f1d53e40d]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:01:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8a3d6b2c-820f-4e71-a4e5-1aa5668b3c59 tempest-SnapshotDependencyTests-1724648070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee.7691ec88-5247-41ff-996b-5311bbd23d34 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:01:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8a3d6b2c-820f-4e71-a4e5-1aa5668b3c59 tempest-SnapshotDependencyTests-1724648070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee.7691ec88-5247-41ff-996b-5311bbd23d34" returned: 0 in 0.481s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:01:15 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-8a3d6b2c-820f-4e71-a4e5-1aa5668b3c59 tempest-SnapshotDependencyTests-1724648070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87f06b73-d040-464c-b284-e10e8797a2ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 12:01:15 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aeaf0eb-8c4a-406d-ae71-298539d5801d]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:01:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8a3d6b2c-820f-4e71-a4e5-1aa5668b3c59 tempest-SnapshotDependencyTests-1724648070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:01:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8a3d6b2c-820f-4e71-a4e5-1aa5668b3c59 tempest-SnapshotDependencyTests-1724648070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee" returned: 0 in 0.539s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:01:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8a3d6b2c-820f-4e71-a4e5-1aa5668b3c59 tempest-SnapshotDependencyTests-1724648070 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee.7691ec88-5247-41ff-996b-5311bbd23d34 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:01:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8a3d6b2c-820f-4e71-a4e5-1aa5668b3c59 tempest-SnapshotDependencyTests-1724648070 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee.7691ec88-5247-41ff-996b-5311bbd23d34" returned: 0 in 0.278s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:01:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8a3d6b2c-820f-4e71-a4e5-1aa5668b3c59 tempest-SnapshotDependencyTests-1724648070 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee.7691ec88-5247-41ff-996b-5311bbd23d34 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:01:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8a3d6b2c-820f-4e71-a4e5-1aa5668b3c59 tempest-SnapshotDependencyTests-1724648070 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee.7691ec88-5247-41ff-996b-5311bbd23d34" returned: 0 in 0.105s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:01:16 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-8a3d6b2c-820f-4e71-a4e5-1aa5668b3c59 tempest-SnapshotDependencyTests-1724648070 None] Lock "cinder-quobyte-7691ec88-5247-41ff-996b-5311bbd23d34" released by "_delete_snapshot" :: held 1.769s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:01:16 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-8a3d6b2c-820f-4e71-a4e5-1aa5668b3c59 tempest-SnapshotDependencyTests-1724648070 None] Lock "cinder-quobyte-87f06b73-d040-464c-b284-e10e8797a2ee" released by "delete_snapshot" :: held 1.800s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:01:16 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-8a3d6b2c-820f-4e71-a4e5-1aa5668b3c59 tempest-SnapshotDependencyTests-1724648070 None] Created reservations ['ac6f5977-c094-444c-a410-ca3d2f93900a', '2912dc9b-1937-41af-b85c-be1844278bfa', '679a89ac-8b62-4c62-996c-e198fae3506e', 'e1feea08-4462-46f1-b8fb-037e82b3aac1'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:01:16 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-8a3d6b2c-820f-4e71-a4e5-1aa5668b3c59 tempest-SnapshotDependencyTests-1724648070 None] Delete snapshot completed successfully.
Sep 18 12:01:16 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-8a3d6b2c-820f-4e71-a4e5-1aa5668b3c59 tempest-SnapshotDependencyTests-1724648070 None] Lock "cinder-7691ec88-5247-41ff-996b-5311bbd23d34-delete_snapshot" released by "delete_snapshot" :: held 2.302s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:01:17 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-9fa26086-c38e-4acf-86c5-50b5fde9153c tempest-SnapshotDependencyTests-1724648070 None] Acquiring lock "cinder-87f06b73-d040-464c-b284-e10e8797a2ee-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:01:17 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-9fa26086-c38e-4acf-86c5-50b5fde9153c tempest-SnapshotDependencyTests-1724648070 None] Lock "cinder-87f06b73-d040-464c-b284-e10e8797a2ee-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:01:17 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-9fa26086-c38e-4acf-86c5-50b5fde9153c tempest-SnapshotDependencyTests-1724648070 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:01:17 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-9fa26086-c38e-4acf-86c5-50b5fde9153c tempest-SnapshotDependencyTests-1724648070 None] Acquiring lock "cinder-quobyte-87f06b73-d040-464c-b284-e10e8797a2ee" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:01:17 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-9fa26086-c38e-4acf-86c5-50b5fde9153c tempest-SnapshotDependencyTests-1724648070 None] Lock "cinder-quobyte-87f06b73-d040-464c-b284-e10e8797a2ee" acquired by "delete_volume" :: waited 0.012s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:01:17 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9d8529-9414-4493-ad50-2a96b1258fd6]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:01:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9fa26086-c38e-4acf-86c5-50b5fde9153c tempest-SnapshotDependencyTests-1724648070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:01:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9fa26086-c38e-4acf-86c5-50b5fde9153c tempest-SnapshotDependencyTests-1724648070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee" returned: 0 in 0.550s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:01:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9fa26086-c38e-4acf-86c5-50b5fde9153c tempest-SnapshotDependencyTests-1724648070 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:01:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9fa26086-c38e-4acf-86c5-50b5fde9153c tempest-SnapshotDependencyTests-1724648070 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-87f06b73-d040-464c-b284-e10e8797a2ee" returned: 0 in 0.098s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:01:18 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-9fa26086-c38e-4acf-86c5-50b5fde9153c tempest-SnapshotDependencyTests-1724648070 None] Lock "cinder-quobyte-87f06b73-d040-464c-b284-e10e8797a2ee" released by "delete_volume" :: held 0.854s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:01:18 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-9fa26086-c38e-4acf-86c5-50b5fde9153c tempest-SnapshotDependencyTests-1724648070 None] Created reservations ['204b4fa2-0630-4ce0-8e82-871e614f54f9', 'a6c9ab73-dd84-420d-9231-be61b6b0d602', '447ed69d-c47d-4408-b8de-692f53aecc4e', '6be3bac6-d95e-48f3-ad68-5c89f413ad65'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:01:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-9fa26086-c38e-4acf-86c5-50b5fde9153c tempest-SnapshotDependencyTests-1724648070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:01:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-9fa26086-c38e-4acf-86c5-50b5fde9153c tempest-SnapshotDependencyTests-1724648070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:01:18 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-9fa26086-c38e-4acf-86c5-50b5fde9153c tempest-SnapshotDependencyTests-1724648070 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:01:18 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-9fa26086-c38e-4acf-86c5-50b5fde9153c tempest-SnapshotDependencyTests-1724648070 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:01:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-9fa26086-c38e-4acf-86c5-50b5fde9153c tempest-SnapshotDependencyTests-1724648070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:01:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9fa26086-c38e-4acf-86c5-50b5fde9153c tempest-SnapshotDependencyTests-1724648070 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:01:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9fa26086-c38e-4acf-86c5-50b5fde9153c tempest-SnapshotDependencyTests-1724648070 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.125s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:01:19 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-9fa26086-c38e-4acf-86c5-50b5fde9153c tempest-SnapshotDependencyTests-1724648070 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:01:19 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-9fa26086-c38e-4acf-86c5-50b5fde9153c tempest-SnapshotDependencyTests-1724648070 None] Deleted volume successfully.
Sep 18 12:01:19 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-9fa26086-c38e-4acf-86c5-50b5fde9153c tempest-SnapshotDependencyTests-1724648070 None] Lock "cinder-87f06b73-d040-464c-b284-e10e8797a2ee-delete_volume" released by "delete_volume" :: held 1.865s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:01:19 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-df1e8aa6-2f33-47ed-952a-2670f9448d7d tempest-SnapshotDependencyTests-1724648070 None] Acquiring lock "cinder-48ad8502-2877-4136-992a-12ec5f113dec-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:01:20 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-df1e8aa6-2f33-47ed-952a-2670f9448d7d tempest-SnapshotDependencyTests-1724648070 None] Lock "cinder-48ad8502-2877-4136-992a-12ec5f113dec-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:01:20 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-df1e8aa6-2f33-47ed-952a-2670f9448d7d tempest-SnapshotDependencyTests-1724648070 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:01:20 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-df1e8aa6-2f33-47ed-952a-2670f9448d7d tempest-SnapshotDependencyTests-1724648070 None] Acquiring lock "cinder-quobyte-48ad8502-2877-4136-992a-12ec5f113dec" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:01:20 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-df1e8aa6-2f33-47ed-952a-2670f9448d7d tempest-SnapshotDependencyTests-1724648070 None] Lock "cinder-quobyte-48ad8502-2877-4136-992a-12ec5f113dec" acquired by "delete_volume" :: waited 0.019s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:01:20 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fe1a13-806d-471f-a6ad-5e1c7e5d794e]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:01:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-df1e8aa6-2f33-47ed-952a-2670f9448d7d tempest-SnapshotDependencyTests-1724648070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-48ad8502-2877-4136-992a-12ec5f113dec {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:01:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-df1e8aa6-2f33-47ed-952a-2670f9448d7d tempest-SnapshotDependencyTests-1724648070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-48ad8502-2877-4136-992a-12ec5f113dec" returned: 0 in 0.554s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:01:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-df1e8aa6-2f33-47ed-952a-2670f9448d7d tempest-SnapshotDependencyTests-1724648070 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-48ad8502-2877-4136-992a-12ec5f113dec {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:01:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-df1e8aa6-2f33-47ed-952a-2670f9448d7d tempest-SnapshotDependencyTests-1724648070 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-48ad8502-2877-4136-992a-12ec5f113dec" returned: 0 in 0.140s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:01:21 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-df1e8aa6-2f33-47ed-952a-2670f9448d7d tempest-SnapshotDependencyTests-1724648070 None] Lock "cinder-quobyte-48ad8502-2877-4136-992a-12ec5f113dec" released by "delete_volume" :: held 0.935s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:01:21 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-df1e8aa6-2f33-47ed-952a-2670f9448d7d tempest-SnapshotDependencyTests-1724648070 None] Created reservations ['a948c1d5-6d3e-4478-bd08-2894825b569c', 'e77c4088-f5b5-4bf2-9530-f8b1842c4746', '18ba1d74-ba43-4a87-b1ae-6ba8a5c5ef7e', 'bc90760a-d500-45d1-af21-5fd35389eba2'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:01:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-df1e8aa6-2f33-47ed-952a-2670f9448d7d tempest-SnapshotDependencyTests-1724648070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:01:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-df1e8aa6-2f33-47ed-952a-2670f9448d7d tempest-SnapshotDependencyTests-1724648070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:01:21 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-df1e8aa6-2f33-47ed-952a-2670f9448d7d tempest-SnapshotDependencyTests-1724648070 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:01:21 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-df1e8aa6-2f33-47ed-952a-2670f9448d7d tempest-SnapshotDependencyTests-1724648070 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:01:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-df1e8aa6-2f33-47ed-952a-2670f9448d7d tempest-SnapshotDependencyTests-1724648070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:01:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-df1e8aa6-2f33-47ed-952a-2670f9448d7d tempest-SnapshotDependencyTests-1724648070 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:01:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-df1e8aa6-2f33-47ed-952a-2670f9448d7d tempest-SnapshotDependencyTests-1724648070 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.106s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:01:21 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-df1e8aa6-2f33-47ed-952a-2670f9448d7d tempest-SnapshotDependencyTests-1724648070 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:01:22 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-df1e8aa6-2f33-47ed-952a-2670f9448d7d tempest-SnapshotDependencyTests-1724648070 None] Deleted volume successfully.
Sep 18 12:01:22 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-df1e8aa6-2f33-47ed-952a-2670f9448d7d tempest-SnapshotDependencyTests-1724648070 None] Lock "cinder-48ad8502-2877-4136-992a-12ec5f113dec-delete_volume" released by "delete_volume" :: held 2.285s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:01:31 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=26,cinder:UPDATE=31,cinder:INSERT=8,cinder:DELETE=5 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 12:01:32 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=25,cinder:INSERT=8,cinder:UPDATE=38,cinder:DELETE=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 12:02:14 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 12:02:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:02:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:02:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:02:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:02:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:02:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:02:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.164s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:02:14 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:02:43 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 12:02:43 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:UPDATE=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 12:03:14 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 12:03:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:03:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:03:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:03:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:03:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:03:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:03:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.095s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:03:14 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:03:28 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-9883536d-10d4-468b-8575-9f43ccf52b49 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:03:28 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-9883536d-10d4-468b-8575-9f43ccf52b49 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 12:03:28 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9883536d-10d4-468b-8575-9f43ccf52b49 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Flow 'volume_create_manager' (987b63b5-e200-4780-9788-cf36808a1dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:03:28 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9883536d-10d4-468b-8575-9f43ccf52b49 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9acfbd29-162d-4c5b-bdf1-df70b3a588a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:03:28 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9883536d-10d4-468b-8575-9f43ccf52b49 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9acfbd29-162d-4c5b-bdf1-df70b3a588a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-558061209',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6a3b57c-fb73-4c8a-bc51-87e436a02039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='481f1f8c969244188e9f397a63049304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:03:29Z,use_quota=True,user_id='27c11449338d42f7b01534d017680198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:03:28 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9883536d-10d4-468b-8575-9f43ccf52b49 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd6eaab0-20ae-414b-86ab-2c8b651f95d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:03:28 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9883536d-10d4-468b-8575-9f43ccf52b49 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd6eaab0-20ae-414b-86ab-2c8b651f95d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:03:28 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9883536d-10d4-468b-8575-9f43ccf52b49 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83d40d15-2f93-43f2-b2f1-e7eb69af6d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:03:28 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9883536d-10d4-468b-8575-9f43ccf52b49 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83d40d15-2f93-43f2-b2f1-e7eb69af6d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6a3b57c-fb73-4c8a-bc51-87e436a02039', 'volume_name': 'volume-c6a3b57c-fb73-4c8a-bc51-87e436a02039', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:03:28 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9883536d-10d4-468b-8575-9f43ccf52b49 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83d521d3-aefc-4c63-b957-df13d88c5127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:03:28 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9883536d-10d4-468b-8575-9f43ccf52b49 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83d521d3-aefc-4c63-b957-df13d88c5127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:03:28 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9883536d-10d4-468b-8575-9f43ccf52b49 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a475897a-7b51-471c-8bc6-04ee78b63411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:03:28 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-9883536d-10d4-468b-8575-9f43ccf52b49 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Volume c6a3b57c-fb73-4c8a-bc51-87e436a02039: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6a3b57c-fb73-4c8a-bc51-87e436a02039', 'volume_size': 1}
Sep 18 12:03:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-9883536d-10d4-468b-8575-9f43ccf52b49 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:03:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-9883536d-10d4-468b-8575-9f43ccf52b49 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:03:28 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-9883536d-10d4-468b-8575-9f43ccf52b49 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-558061209',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6a3b57c-fb73-4c8a-bc51-87e436a02039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='481f1f8c969244188e9f397a63049304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:03:29Z,use_quota=True,user_id='27c11449338d42f7b01534d017680198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 12:03:28 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-9883536d-10d4-468b-8575-9f43ccf52b49 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Creating volume c6a3b57c-fb73-4c8a-bc51-87e436a02039 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 12:03:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-9883536d-10d4-468b-8575-9f43ccf52b49 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:03:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-9883536d-10d4-468b-8575-9f43ccf52b49 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:03:28 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-9883536d-10d4-468b-8575-9f43ccf52b49 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:03:28 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-9883536d-10d4-468b-8575-9f43ccf52b49 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:03:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-9883536d-10d4-468b-8575-9f43ccf52b49 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:03:28 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-9883536d-10d4-468b-8575-9f43ccf52b49 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 12:03:28 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-9883536d-10d4-468b-8575-9f43ccf52b49 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 12:03:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9883536d-10d4-468b-8575-9f43ccf52b49 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c6a3b57c-fb73-4c8a-bc51-87e436a02039 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:03:29 devstack quobyte-client[83193]: System call of process 97707 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 12:03:29 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=134, name=volume-c6a3b57c-fb73-4c8a-bc51-87e436a02039, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:03:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9883536d-10d4-468b-8575-9f43ccf52b49 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c6a3b57c-fb73-4c8a-bc51-87e436a02039 1073741824" returned: 0 in 0.393s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:03:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9883536d-10d4-468b-8575-9f43ccf52b49 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c6a3b57c-fb73-4c8a-bc51-87e436a02039 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:03:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9883536d-10d4-468b-8575-9f43ccf52b49 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c6a3b57c-fb73-4c8a-bc51-87e436a02039" returned: 0 in 0.101s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:03:29 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-9883536d-10d4-468b-8575-9f43ccf52b49 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] <== create_volume: return (555ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 12:03:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-9883536d-10d4-468b-8575-9f43ccf52b49 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.566s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:03:29 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9883536d-10d4-468b-8575-9f43ccf52b49 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a475897a-7b51-471c-8bc6-04ee78b63411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6a3b57c-fb73-4c8a-bc51-87e436a02039', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:03:29 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9883536d-10d4-468b-8575-9f43ccf52b49 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a7be986-2b90-4a6e-b92b-7f9770773401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:03:29 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-9883536d-10d4-468b-8575-9f43ccf52b49 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Volume volume-c6a3b57c-fb73-4c8a-bc51-87e436a02039 (c6a3b57c-fb73-4c8a-bc51-87e436a02039): created successfully
Sep 18 12:03:29 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9883536d-10d4-468b-8575-9f43ccf52b49 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a7be986-2b90-4a6e-b92b-7f9770773401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:03:29 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-9883536d-10d4-468b-8575-9f43ccf52b49 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Flow 'volume_create_manager' (987b63b5-e200-4780-9788-cf36808a1dec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:03:29 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-9883536d-10d4-468b-8575-9f43ccf52b49 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Created volume successfully.
Sep 18 12:03:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-ffa2d4c7-1ea5-4566-bc5f-31c429f53eb4 req-82e483ae-157f-406d-a38a-6c0fcef142ea tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:03:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-ffa2d4c7-1ea5-4566-bc5f-31c429f53eb4 req-82e483ae-157f-406d-a38a-6c0fcef142ea tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:03:34 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a64b4bb-f1e2-43d1-96a6-a870c263cef4]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:03:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-ffa2d4c7-1ea5-4566-bc5f-31c429f53eb4 req-82e483ae-157f-406d-a38a-6c0fcef142ea tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c6a3b57c-fb73-4c8a-bc51-87e436a02039 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:03:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-ffa2d4c7-1ea5-4566-bc5f-31c429f53eb4 req-82e483ae-157f-406d-a38a-6c0fcef142ea tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c6a3b57c-fb73-4c8a-bc51-87e436a02039" returned: 0 in 0.382s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:03:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-ffa2d4c7-1ea5-4566-bc5f-31c429f53eb4 req-82e483ae-157f-406d-a38a-6c0fcef142ea tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.441s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:03:35 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-ffa2d4c7-1ea5-4566-bc5f-31c429f53eb4 req-82e483ae-157f-406d-a38a-6c0fcef142ea tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8', 'name': 'volume-c6a3b57c-fb73-4c8a-bc51-87e436a02039', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '67de337a-b651-4179-a693-bb6146744231', 'enforce_multipath': True} {{(pid=83176) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 12:03:35 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-ffa2d4c7-1ea5-4566-bc5f-31c429f53eb4 req-82e483ae-157f-406d-a38a-6c0fcef142ea tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:03:35 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-ffa2d4c7-1ea5-4566-bc5f-31c429f53eb4 req-82e483ae-157f-406d-a38a-6c0fcef142ea tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] attachment_update completed successfully.
Sep 18 12:03:45 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 12:03:45 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:UPDATE=5,cinder:DELETE=1,cinder:SELECT=7 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 12:04:05 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-acf77adf-be02-424e-8329-6c1f921dd3a0 req-6fe8ece6-6d0a-4f87-8c2e-6440e47b90b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:04:05 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-acf77adf-be02-424e-8329-6c1f921dd3a0 req-6fe8ece6-6d0a-4f87-8c2e-6440e47b90b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:04:05 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-acf77adf-be02-424e-8329-6c1f921dd3a0 req-6fe8ece6-6d0a-4f87-8c2e-6440e47b90b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Terminate volume connection completed successfully.
Sep 18 12:04:05 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-acf77adf-be02-424e-8329-6c1f921dd3a0 req-6fe8ece6-6d0a-4f87-8c2e-6440e47b90b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Deleting attachment 67de337a-b651-4179-a693-bb6146744231. {{(pid=83176) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 12:04:06 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-b9014b6f-d00d-4da4-b672-b7a7967b8789 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Acquiring lock "cinder-c6a3b57c-fb73-4c8a-bc51-87e436a02039-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:04:06 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-b9014b6f-d00d-4da4-b672-b7a7967b8789 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Lock "cinder-c6a3b57c-fb73-4c8a-bc51-87e436a02039-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:04:06 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-b9014b6f-d00d-4da4-b672-b7a7967b8789 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:04:06 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-b9014b6f-d00d-4da4-b672-b7a7967b8789 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Acquiring lock "cinder-quobyte-c6a3b57c-fb73-4c8a-bc51-87e436a02039" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:04:06 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-b9014b6f-d00d-4da4-b672-b7a7967b8789 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Lock "cinder-quobyte-c6a3b57c-fb73-4c8a-bc51-87e436a02039" acquired by "delete_volume" :: waited 0.011s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:04:06 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd6d1b6-fccd-4bb1-a19d-e395a2d595da]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:04:06 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b9014b6f-d00d-4da4-b672-b7a7967b8789 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c6a3b57c-fb73-4c8a-bc51-87e436a02039 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:04:07 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b9014b6f-d00d-4da4-b672-b7a7967b8789 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c6a3b57c-fb73-4c8a-bc51-87e436a02039" returned: 0 in 0.403s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:04:07 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b9014b6f-d00d-4da4-b672-b7a7967b8789 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c6a3b57c-fb73-4c8a-bc51-87e436a02039 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:04:07 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b9014b6f-d00d-4da4-b672-b7a7967b8789 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c6a3b57c-fb73-4c8a-bc51-87e436a02039" returned: 0 in 0.108s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:04:07 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-b9014b6f-d00d-4da4-b672-b7a7967b8789 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Lock "cinder-quobyte-c6a3b57c-fb73-4c8a-bc51-87e436a02039" released by "delete_volume" :: held 0.651s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:04:07 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-b9014b6f-d00d-4da4-b672-b7a7967b8789 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Created reservations ['0fa548cf-6b79-4b0b-9172-292ecb0bc471', '6808d9b6-1777-47e5-b8aa-08d580a055c1', '0b877260-7a12-4f94-960f-590615cb1b18', 'c9828a46-2a52-44ea-b604-1756bb6898be'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:04:07 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-b9014b6f-d00d-4da4-b672-b7a7967b8789 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:04:07 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-b9014b6f-d00d-4da4-b672-b7a7967b8789 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:04:07 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-b9014b6f-d00d-4da4-b672-b7a7967b8789 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:04:07 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-b9014b6f-d00d-4da4-b672-b7a7967b8789 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:04:07 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-b9014b6f-d00d-4da4-b672-b7a7967b8789 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:04:07 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b9014b6f-d00d-4da4-b672-b7a7967b8789 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:04:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b9014b6f-d00d-4da4-b672-b7a7967b8789 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.175s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:04:08 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-b9014b6f-d00d-4da4-b672-b7a7967b8789 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:04:08 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-b9014b6f-d00d-4da4-b672-b7a7967b8789 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Deleted volume successfully.
Sep 18 12:04:08 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-b9014b6f-d00d-4da4-b672-b7a7967b8789 tempest-TestServerVolumeAttachScenarioOldVersion-2069881456 None] Lock "cinder-c6a3b57c-fb73-4c8a-bc51-87e436a02039-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:04:14 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 12:04:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:04:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:04:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:04:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:04:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:04:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:04:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.087s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:04:14 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:04:17 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=12 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 12:04:18 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4,cinder:INSERT=2,cinder:DELETE=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 12:04:43 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 12:04:43 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:UPDATE=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 12:04:50 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-084174b1-6c90-4285-97f4-68775a96ebb8 tempest-TestServerVolumeAttachmentScenario-1053726728 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:04:50 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-084174b1-6c90-4285-97f4-68775a96ebb8 tempest-TestServerVolumeAttachmentScenario-1053726728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 12:04:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-084174b1-6c90-4285-97f4-68775a96ebb8 tempest-TestServerVolumeAttachmentScenario-1053726728 None] Flow 'volume_create_manager' (e575f4f6-944f-45b9-bdda-e1c85dd748ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:04:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-084174b1-6c90-4285-97f4-68775a96ebb8 tempest-TestServerVolumeAttachmentScenario-1053726728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9531d1ef-0f32-4986-a005-cf91acbd648e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:04:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-084174b1-6c90-4285-97f4-68775a96ebb8 tempest-TestServerVolumeAttachmentScenario-1053726728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9531d1ef-0f32-4986-a005-cf91acbd648e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-731777393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbdb0f19-ab84-4c68-b6c8-342957571f47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d17b957f968f4d188bbb67e59f877079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:04:50Z,use_quota=True,user_id='9cdcf1f0c5d041f0a805d949196a8319',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:04:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-084174b1-6c90-4285-97f4-68775a96ebb8 tempest-TestServerVolumeAttachmentScenario-1053726728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34ca2f14-563d-483c-92a0-bb32504228b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:04:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-084174b1-6c90-4285-97f4-68775a96ebb8 tempest-TestServerVolumeAttachmentScenario-1053726728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34ca2f14-563d-483c-92a0-bb32504228b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:04:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-084174b1-6c90-4285-97f4-68775a96ebb8 tempest-TestServerVolumeAttachmentScenario-1053726728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91003d17-ab41-4b0e-91db-6585a300e708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:04:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-084174b1-6c90-4285-97f4-68775a96ebb8 tempest-TestServerVolumeAttachmentScenario-1053726728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91003d17-ab41-4b0e-91db-6585a300e708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbdb0f19-ab84-4c68-b6c8-342957571f47', 'volume_name': 'volume-bbdb0f19-ab84-4c68-b6c8-342957571f47', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:04:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-084174b1-6c90-4285-97f4-68775a96ebb8 tempest-TestServerVolumeAttachmentScenario-1053726728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dde856c-1d75-449b-bd65-3ebb58c7e348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:04:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-084174b1-6c90-4285-97f4-68775a96ebb8 tempest-TestServerVolumeAttachmentScenario-1053726728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dde856c-1d75-449b-bd65-3ebb58c7e348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:04:50 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-084174b1-6c90-4285-97f4-68775a96ebb8 tempest-TestServerVolumeAttachmentScenario-1053726728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98b6b25f-e40c-407d-b9f7-dd44173444b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:04:50 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-084174b1-6c90-4285-97f4-68775a96ebb8 tempest-TestServerVolumeAttachmentScenario-1053726728 None] Volume bbdb0f19-ab84-4c68-b6c8-342957571f47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbdb0f19-ab84-4c68-b6c8-342957571f47', 'volume_size': 1}
Sep 18 12:04:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-084174b1-6c90-4285-97f4-68775a96ebb8 tempest-TestServerVolumeAttachmentScenario-1053726728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:04:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-084174b1-6c90-4285-97f4-68775a96ebb8 tempest-TestServerVolumeAttachmentScenario-1053726728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:04:50 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-084174b1-6c90-4285-97f4-68775a96ebb8 tempest-TestServerVolumeAttachmentScenario-1053726728 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-731777393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbdb0f19-ab84-4c68-b6c8-342957571f47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d17b957f968f4d188bbb67e59f877079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:04:50Z,use_quota=True,user_id='9cdcf1f0c5d041f0a805d949196a8319',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 12:04:50 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-084174b1-6c90-4285-97f4-68775a96ebb8 tempest-TestServerVolumeAttachmentScenario-1053726728 None] Creating volume bbdb0f19-ab84-4c68-b6c8-342957571f47 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 12:04:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-084174b1-6c90-4285-97f4-68775a96ebb8 tempest-TestServerVolumeAttachmentScenario-1053726728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:04:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-084174b1-6c90-4285-97f4-68775a96ebb8 tempest-TestServerVolumeAttachmentScenario-1053726728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:04:50 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-084174b1-6c90-4285-97f4-68775a96ebb8 tempest-TestServerVolumeAttachmentScenario-1053726728 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:04:50 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-084174b1-6c90-4285-97f4-68775a96ebb8 tempest-TestServerVolumeAttachmentScenario-1053726728 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:04:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-084174b1-6c90-4285-97f4-68775a96ebb8 tempest-TestServerVolumeAttachmentScenario-1053726728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:04:50 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-084174b1-6c90-4285-97f4-68775a96ebb8 tempest-TestServerVolumeAttachmentScenario-1053726728 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 12:04:50 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-084174b1-6c90-4285-97f4-68775a96ebb8 tempest-TestServerVolumeAttachmentScenario-1053726728 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 12:04:50 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-084174b1-6c90-4285-97f4-68775a96ebb8 tempest-TestServerVolumeAttachmentScenario-1053726728 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-bbdb0f19-ab84-4c68-b6c8-342957571f47 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:04:50 devstack quobyte-client[83193]: System call of process 98255 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 12:04:50 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=135, name=volume-bbdb0f19-ab84-4c68-b6c8-342957571f47, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:04:51 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-084174b1-6c90-4285-97f4-68775a96ebb8 tempest-TestServerVolumeAttachmentScenario-1053726728 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-bbdb0f19-ab84-4c68-b6c8-342957571f47 1073741824" returned: 0 in 0.507s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:04:51 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-084174b1-6c90-4285-97f4-68775a96ebb8 tempest-TestServerVolumeAttachmentScenario-1053726728 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-bbdb0f19-ab84-4c68-b6c8-342957571f47 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:04:51 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-33e6b194-d524-4aff-bfde-e235d5e3b46c tempest-TestServerVolumeAttachmentScenario-1053726728 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:04:51 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-33e6b194-d524-4aff-bfde-e235d5e3b46c tempest-TestServerVolumeAttachmentScenario-1053726728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 12:04:51 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-33e6b194-d524-4aff-bfde-e235d5e3b46c tempest-TestServerVolumeAttachmentScenario-1053726728 None] Flow 'volume_create_manager' (995d0de9-24c8-41f6-a351-b17336cc364e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:04:51 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-33e6b194-d524-4aff-bfde-e235d5e3b46c tempest-TestServerVolumeAttachmentScenario-1053726728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45f6bdba-7c3e-4023-9bb7-93fa463daaad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:04:51 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-084174b1-6c90-4285-97f4-68775a96ebb8 tempest-TestServerVolumeAttachmentScenario-1053726728 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-bbdb0f19-ab84-4c68-b6c8-342957571f47" returned: 0 in 0.460s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:04:51 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-084174b1-6c90-4285-97f4-68775a96ebb8 tempest-TestServerVolumeAttachmentScenario-1053726728 None] <== create_volume: return (1002ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 12:04:51 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-084174b1-6c90-4285-97f4-68775a96ebb8 tempest-TestServerVolumeAttachmentScenario-1053726728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:04:51 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-33e6b194-d524-4aff-bfde-e235d5e3b46c tempest-TestServerVolumeAttachmentScenario-1053726728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45f6bdba-7c3e-4023-9bb7-93fa463daaad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1408524312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c711045e-536b-4ed3-a188-c3e8ce1dd744,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d17b957f968f4d188bbb67e59f877079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:04:51Z,use_quota=True,user_id='9cdcf1f0c5d041f0a805d949196a8319',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:04:51 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-33e6b194-d524-4aff-bfde-e235d5e3b46c tempest-TestServerVolumeAttachmentScenario-1053726728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41f4a906-7baf-4822-b168-5194cf2f3ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:04:51 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-33e6b194-d524-4aff-bfde-e235d5e3b46c tempest-TestServerVolumeAttachmentScenario-1053726728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41f4a906-7baf-4822-b168-5194cf2f3ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:04:51 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-33e6b194-d524-4aff-bfde-e235d5e3b46c tempest-TestServerVolumeAttachmentScenario-1053726728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cef1d01-ab66-42e6-9acf-3d8f85ee5031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:04:51 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-33e6b194-d524-4aff-bfde-e235d5e3b46c tempest-TestServerVolumeAttachmentScenario-1053726728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cef1d01-ab66-42e6-9acf-3d8f85ee5031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c711045e-536b-4ed3-a188-c3e8ce1dd744', 'volume_name': 'volume-c711045e-536b-4ed3-a188-c3e8ce1dd744', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:04:51 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-33e6b194-d524-4aff-bfde-e235d5e3b46c tempest-TestServerVolumeAttachmentScenario-1053726728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c28b3457-a7f5-4d80-88db-416497deeac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:04:51 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-33e6b194-d524-4aff-bfde-e235d5e3b46c tempest-TestServerVolumeAttachmentScenario-1053726728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c28b3457-a7f5-4d80-88db-416497deeac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:04:51 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-33e6b194-d524-4aff-bfde-e235d5e3b46c tempest-TestServerVolumeAttachmentScenario-1053726728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fbe3371-bd33-4f55-aa90-dffc0d173570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:04:51 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-33e6b194-d524-4aff-bfde-e235d5e3b46c tempest-TestServerVolumeAttachmentScenario-1053726728 None] Volume c711045e-536b-4ed3-a188-c3e8ce1dd744: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c711045e-536b-4ed3-a188-c3e8ce1dd744', 'volume_size': 1}
Sep 18 12:04:51 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-33e6b194-d524-4aff-bfde-e235d5e3b46c tempest-TestServerVolumeAttachmentScenario-1053726728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:04:51 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-33e6b194-d524-4aff-bfde-e235d5e3b46c tempest-TestServerVolumeAttachmentScenario-1053726728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:04:51 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-33e6b194-d524-4aff-bfde-e235d5e3b46c tempest-TestServerVolumeAttachmentScenario-1053726728 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1408524312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c711045e-536b-4ed3-a188-c3e8ce1dd744,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d17b957f968f4d188bbb67e59f877079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:04:51Z,use_quota=True,user_id='9cdcf1f0c5d041f0a805d949196a8319',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 12:04:51 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-33e6b194-d524-4aff-bfde-e235d5e3b46c tempest-TestServerVolumeAttachmentScenario-1053726728 None] Creating volume c711045e-536b-4ed3-a188-c3e8ce1dd744 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 12:04:51 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-33e6b194-d524-4aff-bfde-e235d5e3b46c tempest-TestServerVolumeAttachmentScenario-1053726728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:04:51 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-33e6b194-d524-4aff-bfde-e235d5e3b46c tempest-TestServerVolumeAttachmentScenario-1053726728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:04:51 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-33e6b194-d524-4aff-bfde-e235d5e3b46c tempest-TestServerVolumeAttachmentScenario-1053726728 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:04:51 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-33e6b194-d524-4aff-bfde-e235d5e3b46c tempest-TestServerVolumeAttachmentScenario-1053726728 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:04:51 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-33e6b194-d524-4aff-bfde-e235d5e3b46c tempest-TestServerVolumeAttachmentScenario-1053726728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:04:51 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-33e6b194-d524-4aff-bfde-e235d5e3b46c tempest-TestServerVolumeAttachmentScenario-1053726728 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 12:04:51 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-33e6b194-d524-4aff-bfde-e235d5e3b46c tempest-TestServerVolumeAttachmentScenario-1053726728 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 12:04:51 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-33e6b194-d524-4aff-bfde-e235d5e3b46c tempest-TestServerVolumeAttachmentScenario-1053726728 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c711045e-536b-4ed3-a188-c3e8ce1dd744 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:04:51 devstack quobyte-client[83193]: System call of process 98259 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 12:04:51 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=136, name=volume-c711045e-536b-4ed3-a188-c3e8ce1dd744, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:04:51 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-084174b1-6c90-4285-97f4-68775a96ebb8 tempest-TestServerVolumeAttachmentScenario-1053726728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98b6b25f-e40c-407d-b9f7-dd44173444b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbdb0f19-ab84-4c68-b6c8-342957571f47', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:04:52 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-084174b1-6c90-4285-97f4-68775a96ebb8 tempest-TestServerVolumeAttachmentScenario-1053726728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ad1568-0960-46de-bf7c-c328b6791af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:04:52 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-084174b1-6c90-4285-97f4-68775a96ebb8 tempest-TestServerVolumeAttachmentScenario-1053726728 None] Volume volume-bbdb0f19-ab84-4c68-b6c8-342957571f47 (bbdb0f19-ab84-4c68-b6c8-342957571f47): created successfully
Sep 18 12:04:52 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-084174b1-6c90-4285-97f4-68775a96ebb8 tempest-TestServerVolumeAttachmentScenario-1053726728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ad1568-0960-46de-bf7c-c328b6791af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:04:52 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-084174b1-6c90-4285-97f4-68775a96ebb8 tempest-TestServerVolumeAttachmentScenario-1053726728 None] Flow 'volume_create_manager' (e575f4f6-944f-45b9-bdda-e1c85dd748ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:04:52 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-084174b1-6c90-4285-97f4-68775a96ebb8 tempest-TestServerVolumeAttachmentScenario-1053726728 None] Created volume successfully.
Sep 18 12:04:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-33e6b194-d524-4aff-bfde-e235d5e3b46c tempest-TestServerVolumeAttachmentScenario-1053726728 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c711045e-536b-4ed3-a188-c3e8ce1dd744 1073741824" returned: 0 in 0.681s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:04:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-33e6b194-d524-4aff-bfde-e235d5e3b46c tempest-TestServerVolumeAttachmentScenario-1053726728 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c711045e-536b-4ed3-a188-c3e8ce1dd744 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:04:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-33e6b194-d524-4aff-bfde-e235d5e3b46c tempest-TestServerVolumeAttachmentScenario-1053726728 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c711045e-536b-4ed3-a188-c3e8ce1dd744" returned: 0 in 0.273s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:04:52 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-33e6b194-d524-4aff-bfde-e235d5e3b46c tempest-TestServerVolumeAttachmentScenario-1053726728 None] <== create_volume: return (1033ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 12:04:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-33e6b194-d524-4aff-bfde-e235d5e3b46c tempest-TestServerVolumeAttachmentScenario-1053726728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:04:52 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-33e6b194-d524-4aff-bfde-e235d5e3b46c tempest-TestServerVolumeAttachmentScenario-1053726728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fbe3371-bd33-4f55-aa90-dffc0d173570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c711045e-536b-4ed3-a188-c3e8ce1dd744', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:04:52 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-33e6b194-d524-4aff-bfde-e235d5e3b46c tempest-TestServerVolumeAttachmentScenario-1053726728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30d2ed82-c763-4d76-91bc-803055d377c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:04:53 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-33e6b194-d524-4aff-bfde-e235d5e3b46c tempest-TestServerVolumeAttachmentScenario-1053726728 None] Volume volume-c711045e-536b-4ed3-a188-c3e8ce1dd744 (c711045e-536b-4ed3-a188-c3e8ce1dd744): created successfully
Sep 18 12:04:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-33e6b194-d524-4aff-bfde-e235d5e3b46c tempest-TestServerVolumeAttachmentScenario-1053726728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30d2ed82-c763-4d76-91bc-803055d377c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:04:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-33e6b194-d524-4aff-bfde-e235d5e3b46c tempest-TestServerVolumeAttachmentScenario-1053726728 None] Flow 'volume_create_manager' (995d0de9-24c8-41f6-a351-b17336cc364e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:04:53 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-33e6b194-d524-4aff-bfde-e235d5e3b46c tempest-TestServerVolumeAttachmentScenario-1053726728 None] Created volume successfully.
Sep 18 12:05:02 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:UPDATE=5,cinder:SELECT=2 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 12:05:03 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:DELETE=2 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 12:05:14 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 12:05:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:05:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:05:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:05:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:05:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:05:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:05:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.090s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:05:14 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:06:14 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 12:06:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:06:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:06:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:06:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:06:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:06:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:06:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.084s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:06:14 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:06:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-3b0e5f09-5d92-4532-9122-5f4206f2ad74 req-24fe3011-d803-44c6-b1c4-39796e2ef44f tempest-TestServerVolumeAttachmentScenario-1053726728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:06:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-3b0e5f09-5d92-4532-9122-5f4206f2ad74 req-24fe3011-d803-44c6-b1c4-39796e2ef44f tempest-TestServerVolumeAttachmentScenario-1053726728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:06:26 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf5444a-2954-48de-90b2-54789e7d659a]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:06:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-3b0e5f09-5d92-4532-9122-5f4206f2ad74 req-24fe3011-d803-44c6-b1c4-39796e2ef44f tempest-TestServerVolumeAttachmentScenario-1053726728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-bbdb0f19-ab84-4c68-b6c8-342957571f47 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:06:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-3b0e5f09-5d92-4532-9122-5f4206f2ad74 req-24fe3011-d803-44c6-b1c4-39796e2ef44f tempest-TestServerVolumeAttachmentScenario-1053726728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-bbdb0f19-ab84-4c68-b6c8-342957571f47" returned: 0 in 0.430s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:06:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-3b0e5f09-5d92-4532-9122-5f4206f2ad74 req-24fe3011-d803-44c6-b1c4-39796e2ef44f tempest-TestServerVolumeAttachmentScenario-1053726728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.494s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:06:27 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-3b0e5f09-5d92-4532-9122-5f4206f2ad74 req-24fe3011-d803-44c6-b1c4-39796e2ef44f tempest-TestServerVolumeAttachmentScenario-1053726728 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8', 'name': 'volume-bbdb0f19-ab84-4c68-b6c8-342957571f47', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '461c7114-603f-462c-90bf-6bce17f5e1ae', 'enforce_multipath': True} {{(pid=83176) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 12:06:27 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-3b0e5f09-5d92-4532-9122-5f4206f2ad74 req-24fe3011-d803-44c6-b1c4-39796e2ef44f tempest-TestServerVolumeAttachmentScenario-1053726728 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:06:27 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-3b0e5f09-5d92-4532-9122-5f4206f2ad74 req-24fe3011-d803-44c6-b1c4-39796e2ef44f tempest-TestServerVolumeAttachmentScenario-1053726728 None] attachment_update completed successfully.
Sep 18 12:06:39 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-cce24d05-dba3-49dc-9b91-be99fff19b5b req-a662987c-acdb-4c2b-8816-e82ee4c47c5b tempest-TestServerVolumeAttachmentScenario-1053726728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:06:39 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-cce24d05-dba3-49dc-9b91-be99fff19b5b req-a662987c-acdb-4c2b-8816-e82ee4c47c5b tempest-TestServerVolumeAttachmentScenario-1053726728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:06:39 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d51ce5-159c-4321-8ad1-a1714f3186f4]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:06:39 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-cce24d05-dba3-49dc-9b91-be99fff19b5b req-a662987c-acdb-4c2b-8816-e82ee4c47c5b tempest-TestServerVolumeAttachmentScenario-1053726728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c711045e-536b-4ed3-a188-c3e8ce1dd744 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:06:39 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-cce24d05-dba3-49dc-9b91-be99fff19b5b req-a662987c-acdb-4c2b-8816-e82ee4c47c5b tempest-TestServerVolumeAttachmentScenario-1053726728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c711045e-536b-4ed3-a188-c3e8ce1dd744" returned: 0 in 0.407s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:06:39 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-cce24d05-dba3-49dc-9b91-be99fff19b5b req-a662987c-acdb-4c2b-8816-e82ee4c47c5b tempest-TestServerVolumeAttachmentScenario-1053726728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.458s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:06:40 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-cce24d05-dba3-49dc-9b91-be99fff19b5b req-a662987c-acdb-4c2b-8816-e82ee4c47c5b tempest-TestServerVolumeAttachmentScenario-1053726728 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8', 'name': 'volume-c711045e-536b-4ed3-a188-c3e8ce1dd744', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f36a6d13-0f26-4107-be9c-741344147cb1', 'enforce_multipath': True} {{(pid=83176) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 12:06:40 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-cce24d05-dba3-49dc-9b91-be99fff19b5b req-a662987c-acdb-4c2b-8816-e82ee4c47c5b tempest-TestServerVolumeAttachmentScenario-1053726728 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:06:40 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-cce24d05-dba3-49dc-9b91-be99fff19b5b req-a662987c-acdb-4c2b-8816-e82ee4c47c5b tempest-TestServerVolumeAttachmentScenario-1053726728 None] attachment_update completed successfully.
Sep 18 12:06:50 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=10,cinder:UPDATE=5 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 12:06:50 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=13,cinder:UPDATE=2 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 12:07:07 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-70680f58-b18a-4c36-856a-092d1e7c56f6 req-2b21919e-8935-4563-9a59-6e111415e296 tempest-TestServerVolumeAttachmentScenario-1053726728 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:07:07 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-70680f58-b18a-4c36-856a-092d1e7c56f6 req-2b21919e-8935-4563-9a59-6e111415e296 tempest-TestServerVolumeAttachmentScenario-1053726728 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:07:07 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-70680f58-b18a-4c36-856a-092d1e7c56f6 req-2b21919e-8935-4563-9a59-6e111415e296 tempest-TestServerVolumeAttachmentScenario-1053726728 None] Terminate volume connection completed successfully.
Sep 18 12:07:07 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-70680f58-b18a-4c36-856a-092d1e7c56f6 req-2b21919e-8935-4563-9a59-6e111415e296 tempest-TestServerVolumeAttachmentScenario-1053726728 None] Deleting attachment f36a6d13-0f26-4107-be9c-741344147cb1. {{(pid=83176) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 12:07:14 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 12:07:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:07:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:07:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:07:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:07:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:07:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:07:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.086s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:07:14 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:07:17 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=2 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 12:07:31 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-6154aa29-2c5b-4b90-89d9-b43c267121ee req-13769e5c-8b38-4249-90da-838de214c79f tempest-TestServerVolumeAttachmentScenario-1053726728 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:07:31 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-6154aa29-2c5b-4b90-89d9-b43c267121ee req-13769e5c-8b38-4249-90da-838de214c79f tempest-TestServerVolumeAttachmentScenario-1053726728 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:07:31 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-6154aa29-2c5b-4b90-89d9-b43c267121ee req-13769e5c-8b38-4249-90da-838de214c79f tempest-TestServerVolumeAttachmentScenario-1053726728 None] Terminate volume connection completed successfully.
Sep 18 12:07:31 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-6154aa29-2c5b-4b90-89d9-b43c267121ee req-13769e5c-8b38-4249-90da-838de214c79f tempest-TestServerVolumeAttachmentScenario-1053726728 None] Deleting attachment 461c7114-603f-462c-90bf-6bce17f5e1ae. {{(pid=83176) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 12:07:41 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 12:07:41 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 12:07:42 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4839821d-c471-4867-9c3c-d53b3663c89f tempest-TestServerVolumeAttachmentScenario-1053726728 None] Acquiring lock "cinder-c711045e-536b-4ed3-a188-c3e8ce1dd744-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:07:42 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4839821d-c471-4867-9c3c-d53b3663c89f tempest-TestServerVolumeAttachmentScenario-1053726728 None] Lock "cinder-c711045e-536b-4ed3-a188-c3e8ce1dd744-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:07:42 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-4839821d-c471-4867-9c3c-d53b3663c89f tempest-TestServerVolumeAttachmentScenario-1053726728 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:07:42 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4839821d-c471-4867-9c3c-d53b3663c89f tempest-TestServerVolumeAttachmentScenario-1053726728 None] Acquiring lock "cinder-quobyte-c711045e-536b-4ed3-a188-c3e8ce1dd744" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:07:42 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4839821d-c471-4867-9c3c-d53b3663c89f tempest-TestServerVolumeAttachmentScenario-1053726728 None] Lock "cinder-quobyte-c711045e-536b-4ed3-a188-c3e8ce1dd744" acquired by "delete_volume" :: waited 0.012s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:07:42 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cc1a2a-c641-4102-8d1f-81837622f6f0]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:07:42 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4839821d-c471-4867-9c3c-d53b3663c89f tempest-TestServerVolumeAttachmentScenario-1053726728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c711045e-536b-4ed3-a188-c3e8ce1dd744 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:07:42 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4839821d-c471-4867-9c3c-d53b3663c89f tempest-TestServerVolumeAttachmentScenario-1053726728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c711045e-536b-4ed3-a188-c3e8ce1dd744" returned: 0 in 0.419s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:07:42 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4839821d-c471-4867-9c3c-d53b3663c89f tempest-TestServerVolumeAttachmentScenario-1053726728 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c711045e-536b-4ed3-a188-c3e8ce1dd744 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:07:42 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4839821d-c471-4867-9c3c-d53b3663c89f tempest-TestServerVolumeAttachmentScenario-1053726728 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c711045e-536b-4ed3-a188-c3e8ce1dd744" returned: 0 in 0.096s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:07:42 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4839821d-c471-4867-9c3c-d53b3663c89f tempest-TestServerVolumeAttachmentScenario-1053726728 None] Lock "cinder-quobyte-c711045e-536b-4ed3-a188-c3e8ce1dd744" released by "delete_volume" :: held 0.662s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:07:43 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-4839821d-c471-4867-9c3c-d53b3663c89f tempest-TestServerVolumeAttachmentScenario-1053726728 None] Created reservations ['f2d7f80c-d138-4a6c-8de7-085f84911f9d', '398dfc32-0250-4aa5-97d8-643ea7d88dff', 'f1b40261-fcd5-41b8-87c6-eea13d2b0541', 'f472bb5a-6fdb-4f9d-870f-b52a5130f524'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:07:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4839821d-c471-4867-9c3c-d53b3663c89f tempest-TestServerVolumeAttachmentScenario-1053726728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:07:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4839821d-c471-4867-9c3c-d53b3663c89f tempest-TestServerVolumeAttachmentScenario-1053726728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:07:43 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-4839821d-c471-4867-9c3c-d53b3663c89f tempest-TestServerVolumeAttachmentScenario-1053726728 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:07:43 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-4839821d-c471-4867-9c3c-d53b3663c89f tempest-TestServerVolumeAttachmentScenario-1053726728 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:07:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4839821d-c471-4867-9c3c-d53b3663c89f tempest-TestServerVolumeAttachmentScenario-1053726728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:07:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4839821d-c471-4867-9c3c-d53b3663c89f tempest-TestServerVolumeAttachmentScenario-1053726728 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:07:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4839821d-c471-4867-9c3c-d53b3663c89f tempest-TestServerVolumeAttachmentScenario-1053726728 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.170s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:07:43 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-4839821d-c471-4867-9c3c-d53b3663c89f tempest-TestServerVolumeAttachmentScenario-1053726728 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:07:43 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-4839821d-c471-4867-9c3c-d53b3663c89f tempest-TestServerVolumeAttachmentScenario-1053726728 None] Deleted volume successfully.
Sep 18 12:07:43 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4839821d-c471-4867-9c3c-d53b3663c89f tempest-TestServerVolumeAttachmentScenario-1053726728 None] Lock "cinder-c711045e-536b-4ed3-a188-c3e8ce1dd744-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:07:44 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-b7812444-affc-41b5-95e9-1ccec5a0a45d tempest-TestServerVolumeAttachmentScenario-1053726728 None] Acquiring lock "cinder-bbdb0f19-ab84-4c68-b6c8-342957571f47-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:07:44 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-b7812444-affc-41b5-95e9-1ccec5a0a45d tempest-TestServerVolumeAttachmentScenario-1053726728 None] Lock "cinder-bbdb0f19-ab84-4c68-b6c8-342957571f47-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:07:44 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-b7812444-affc-41b5-95e9-1ccec5a0a45d tempest-TestServerVolumeAttachmentScenario-1053726728 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:07:44 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-b7812444-affc-41b5-95e9-1ccec5a0a45d tempest-TestServerVolumeAttachmentScenario-1053726728 None] Acquiring lock "cinder-quobyte-bbdb0f19-ab84-4c68-b6c8-342957571f47" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:07:44 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-b7812444-affc-41b5-95e9-1ccec5a0a45d tempest-TestServerVolumeAttachmentScenario-1053726728 None] Lock "cinder-quobyte-bbdb0f19-ab84-4c68-b6c8-342957571f47" acquired by "delete_volume" :: waited 0.013s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:07:44 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[008e0b41-25e9-4f9a-9239-a601aa054b21]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:07:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b7812444-affc-41b5-95e9-1ccec5a0a45d tempest-TestServerVolumeAttachmentScenario-1053726728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-bbdb0f19-ab84-4c68-b6c8-342957571f47 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:07:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b7812444-affc-41b5-95e9-1ccec5a0a45d tempest-TestServerVolumeAttachmentScenario-1053726728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-bbdb0f19-ab84-4c68-b6c8-342957571f47" returned: 0 in 0.386s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:07:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b7812444-affc-41b5-95e9-1ccec5a0a45d tempest-TestServerVolumeAttachmentScenario-1053726728 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-bbdb0f19-ab84-4c68-b6c8-342957571f47 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:07:45 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b7812444-affc-41b5-95e9-1ccec5a0a45d tempest-TestServerVolumeAttachmentScenario-1053726728 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-bbdb0f19-ab84-4c68-b6c8-342957571f47" returned: 0 in 0.109s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:07:45 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-b7812444-affc-41b5-95e9-1ccec5a0a45d tempest-TestServerVolumeAttachmentScenario-1053726728 None] Lock "cinder-quobyte-bbdb0f19-ab84-4c68-b6c8-342957571f47" released by "delete_volume" :: held 0.629s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:07:45 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-b7812444-affc-41b5-95e9-1ccec5a0a45d tempest-TestServerVolumeAttachmentScenario-1053726728 None] Created reservations ['a6dc3275-3769-444a-a48b-33eefd547cb4', '80dd97d4-8b99-4e64-8517-e4dd16465cb5', 'e2867ed2-2ad3-4891-853d-438ac8d56622', '7610cf18-a962-425a-be14-112d530081e6'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:07:45 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-b7812444-affc-41b5-95e9-1ccec5a0a45d tempest-TestServerVolumeAttachmentScenario-1053726728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:07:45 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-b7812444-affc-41b5-95e9-1ccec5a0a45d tempest-TestServerVolumeAttachmentScenario-1053726728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:07:45 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-b7812444-affc-41b5-95e9-1ccec5a0a45d tempest-TestServerVolumeAttachmentScenario-1053726728 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:07:45 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-b7812444-affc-41b5-95e9-1ccec5a0a45d tempest-TestServerVolumeAttachmentScenario-1053726728 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:07:45 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-b7812444-affc-41b5-95e9-1ccec5a0a45d tempest-TestServerVolumeAttachmentScenario-1053726728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:07:45 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b7812444-affc-41b5-95e9-1ccec5a0a45d tempest-TestServerVolumeAttachmentScenario-1053726728 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:07:45 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b7812444-affc-41b5-95e9-1ccec5a0a45d tempest-TestServerVolumeAttachmentScenario-1053726728 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.103s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:07:45 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-b7812444-affc-41b5-95e9-1ccec5a0a45d tempest-TestServerVolumeAttachmentScenario-1053726728 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:07:45 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-b7812444-affc-41b5-95e9-1ccec5a0a45d tempest-TestServerVolumeAttachmentScenario-1053726728 None] Deleted volume successfully.
Sep 18 12:07:45 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-b7812444-affc-41b5-95e9-1ccec5a0a45d tempest-TestServerVolumeAttachmentScenario-1053726728 None] Lock "cinder-bbdb0f19-ab84-4c68-b6c8-342957571f47-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:07:55 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:UPDATE=18,cinder:SELECT=6,cinder:INSERT=4,cinder:DELETE=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 12:07:55 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=14,cinder:INSERT=4,cinder:UPDATE=14,cinder:DELETE=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 12:08:14 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 12:08:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:08:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:08:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:08:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:08:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:08:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:08:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.118s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:08:14 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:08:22 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:08:22 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 12:08:22 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Flow 'volume_create_manager' (a1f46c4b-1ce6-461a-a144-3b39b02d8177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:08:22 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91331da7-0b09-46a3-8ebb-91c39076b20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:08:22 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91331da7-0b09-46a3-8ebb-91c39076b20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1636825175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2e204c8-f90e-470e-bff3-bef38a37d760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce7ecef6a81a445eb94d9714ffec7a00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:08:22Z,use_quota=True,user_id='611fead110cf47de92385bc4e6035ccf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:08:22 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d8597e9-5d6a-4175-8ef1-4b6dea583c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:08:22 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d8597e9-5d6a-4175-8ef1-4b6dea583c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:08:22 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cd09f5a-0b45-4f0e-9603-4dd922600aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:08:22 devstack cinder-volume[83176]: DEBUG cinder.image.glance [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Creating Keystone auth plugin from conf {{(pid=83176) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 18 12:08:22 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cd09f5a-0b45-4f0e-9603-4dd922600aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a2e204c8-f90e-470e-bff3-bef38a37d760', 'volume_name': 'volume-a2e204c8-f90e-470e-bff3-bef38a37d760', 'volume_size': 1, 'image_id': 'd8f06519-8e17-49ea-ac0c-4df29f548619', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8f06519-8e17-49ea-ac0c-4df29f548619', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '68bc9b408b424a06a12482824dcdb45c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8f06519-8e17-49ea-ac0c-4df29f548619', 'created_at': datetime.datetime(2025, 9, 18, 9, 18, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 9, 18, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8f06519-8e17-49ea-ac0c-4df29f548619/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6ae4496740>}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:08:22 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d756b4-8b2d-4ab3-9f5e-92e5bf5874ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:08:22 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d756b4-8b2d-4ab3-9f5e-92e5bf5874ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:08:22 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2913d5a-f91f-4a78-a200-f08a02d3ee83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:08:22 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Volume a2e204c8-f90e-470e-bff3-bef38a37d760: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a2e204c8-f90e-470e-bff3-bef38a37d760', 'volume_size': 1, 'image_id': 'd8f06519-8e17-49ea-ac0c-4df29f548619', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8f06519-8e17-49ea-ac0c-4df29f548619', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '68bc9b408b424a06a12482824dcdb45c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8f06519-8e17-49ea-ac0c-4df29f548619', 'created_at': datetime.datetime(2025, 9, 18, 9, 18, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 9, 18, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8f06519-8e17-49ea-ac0c-4df29f548619/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6ae4496740>}
Sep 18 12:08:22 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Cloning a2e204c8-f90e-470e-bff3-bef38a37d760 from image d8f06519-8e17-49ea-ac0c-4df29f548619  at location (None, [{'url': 'file:///opt/stack/data/glance/images/d8f06519-8e17-49ea-ac0c-4df29f548619', 'metadata': {}}]). {{(pid=83176) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 18 12:08:23 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_qgy77mpkdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83176) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 18 12:08:23 devstack cinder-volume[83176]: INFO cinder.image.image_utils [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Image download 20.69 MB at 20.69 MB/s
Sep 18 12:08:23 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[05731060-6816-4052-b805-bec8a96adada]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:08:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_qgy77mpkdevstack@QuobyteHD {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:08:23 devstack sudo[99153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_qgy77mpkdevstack@QuobyteHD
Sep 18 12:08:23 devstack sudo[99153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 12:08:25 devstack sudo[99153]: pam_unix(sudo:session): session closed for user root
Sep 18 12:08:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_qgy77mpkdevstack@QuobyteHD" returned: 0 in 1.908s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:08:25 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Temporary image d8f06519-8e17-49ea-ac0c-4df29f548619 is fetched for user 611fead110cf47de92385bc4e6035ccf. {{(pid=83176) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 18 12:08:25 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed3164a-9c7f-49a3-861b-a4ccf158a170]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:08:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_qgy77mpkdevstack@QuobyteHD {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:08:25 devstack sudo[99158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_qgy77mpkdevstack@QuobyteHD
Sep 18 12:08:25 devstack sudo[99158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 12:08:27 devstack sudo[99158]: pam_unix(sudo:session): session closed for user root
Sep 18 12:08:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_qgy77mpkdevstack@QuobyteHD" returned: 0 in 1.889s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:08:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:08:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:08:27 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1636825175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2e204c8-f90e-470e-bff3-bef38a37d760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce7ecef6a81a445eb94d9714ffec7a00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:08:22Z,use_quota=True,user_id='611fead110cf47de92385bc4e6035ccf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 12:08:27 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Creating volume a2e204c8-f90e-470e-bff3-bef38a37d760 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 12:08:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:08:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:08:27 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:08:27 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:08:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:08:27 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 12:08:27 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 12:08:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a2e204c8-f90e-470e-bff3-bef38a37d760 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:08:27 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=137, name=volume-a2e204c8-f90e-470e-bff3-bef38a37d760, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:08:27 devstack quobyte-client[83193]: System call of process 99164 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 12:08:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a2e204c8-f90e-470e-bff3-bef38a37d760 1073741824" returned: 0 in 0.299s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:08:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a2e204c8-f90e-470e-bff3-bef38a37d760 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:08:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a2e204c8-f90e-470e-bff3-bef38a37d760" returned: 0 in 0.079s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:08:27 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] <== create_volume: return (466ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 12:08:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.498s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:08:28 devstack cinder-volume[83176]: DEBUG cinder.volume.volume_utils [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Attempting download of d8f06519-8e17-49ea-ac0c-4df29f548619 ((None, [{'url': 'file:///opt/stack/data/glance/images/d8f06519-8e17-49ea-ac0c-4df29f548619', 'metadata': {}}])) to volume a2e204c8-f90e-470e-bff3-bef38a37d760. {{(pid=83176) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 18 12:08:28 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd787edb-41ad-4e11-8283-24c716a5c117]: (4, 'raw') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:08:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8f06519-8e17-49ea-ac0c-4df29f548619_z1si9ka7 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:08:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8f06519-8e17-49ea-ac0c-4df29f548619_z1si9ka7" returned: 0 in 0.357s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:08:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8f06519-8e17-49ea-ac0c-4df29f548619_z1si9ka7 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:08:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8f06519-8e17-49ea-ac0c-4df29f548619_z1si9ka7" returned: 1 in 0.375s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:08:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8f06519-8e17-49ea-ac0c-4df29f548619_z1si9ka7' failed. Not Retrying. {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 12:08:28 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ecc36c-3d19-4356-b2ee-c5afc5aacadc]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:08:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_qgy77mpkdevstack@QuobyteHD {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:08:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_qgy77mpkdevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:08:29 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] d8f06519-8e17-49ea-ac0c-4df29f548619 was qcow2, converting to raw {{(pid=83176) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 18 12:08:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_qgy77mpkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a2e204c8-f90e-470e-bff3-bef38a37d760 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:08:29 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=137, name=volume-a2e204c8-f90e-470e-bff3-bef38a37d760, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:08:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_qgy77mpkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a2e204c8-f90e-470e-bff3-bef38a37d760" returned: 0 in 0.973s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:08:30 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d8f06519-8e17-49ea-ac0c-4df29f548619_qgy77mpkdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a2e204c8-f90e-470e-bff3-bef38a37d760 {{(pid=83176) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 12:08:30 devstack cinder-volume[83176]: INFO cinder.image.image_utils [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Converted 112.00 MB image at 111.90 MB/s
Sep 18 12:08:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a2e204c8-f90e-470e-bff3-bef38a37d760 1G {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:08:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a2e204c8-f90e-470e-bff3-bef38a37d760 1G" returned: 0 in 0.146s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:08:30 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6d4c08-cbcf-420a-8126-ff9712f7d269]: (4, 'raw') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:08:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a2e204c8-f90e-470e-bff3-bef38a37d760 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:08:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a2e204c8-f90e-470e-bff3-bef38a37d760" returned: 0 in 0.340s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:08:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a2e204c8-f90e-470e-bff3-bef38a37d760 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:08:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a2e204c8-f90e-470e-bff3-bef38a37d760" returned: 1 in 0.333s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:08:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a2e204c8-f90e-470e-bff3-bef38a37d760' failed. Not Retrying. {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 12:08:31 devstack cinder-volume[83176]: DEBUG cinder.volume.volume_utils [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Downloaded image d8f06519-8e17-49ea-ac0c-4df29f548619 ((None, [{'url': 'file:///opt/stack/data/glance/images/d8f06519-8e17-49ea-ac0c-4df29f548619', 'metadata': {}}])) to volume a2e204c8-f90e-470e-bff3-bef38a37d760 successfully. {{(pid=83176) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 18 12:08:31 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Temporary image d8f06519-8e17-49ea-ac0c-4df29f548619 for user 611fead110cf47de92385bc4e6035ccf is deleted. {{(pid=83176) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 18 12:08:31 devstack cinder-volume[83176]: DEBUG cinder.volume.volume_utils [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Marking volume a2e204c8-f90e-470e-bff3-bef38a37d760 as bootable. {{(pid=83176) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 18 12:08:31 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Copying metadata from image d8f06519-8e17-49ea-ac0c-4df29f548619 to a2e204c8-f90e-470e-bff3-bef38a37d760. {{(pid=83176) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 18 12:08:31 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Creating volume glance metadata for volume a2e204c8-f90e-470e-bff3-bef38a37d760 backed by image d8f06519-8e17-49ea-ac0c-4df29f548619 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd8f06519-8e17-49ea-ac0c-4df29f548619', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83176) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 18 12:08:31 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2913d5a-f91f-4a78-a200-f08a02d3ee83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2e204c8-f90e-470e-bff3-bef38a37d760', 'volume_size': 1, 'image_id': 'd8f06519-8e17-49ea-ac0c-4df29f548619', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8f06519-8e17-49ea-ac0c-4df29f548619', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '68bc9b408b424a06a12482824dcdb45c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8f06519-8e17-49ea-ac0c-4df29f548619', 'created_at': datetime.datetime(2025, 9, 18, 9, 18, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 9, 18, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8f06519-8e17-49ea-ac0c-4df29f548619/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6ae4496740>}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:08:31 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9db27a9f-b443-42fd-8650-f367b7779517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:08:31 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Volume volume-a2e204c8-f90e-470e-bff3-bef38a37d760 (a2e204c8-f90e-470e-bff3-bef38a37d760): created successfully
Sep 18 12:08:31 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9db27a9f-b443-42fd-8650-f367b7779517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:08:31 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Flow 'volume_create_manager' (a1f46c4b-1ce6-461a-a144-3b39b02d8177) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:08:31 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-7d1f83fa-a042-4ac5-9e03-b1635a3d8d4f tempest-TestShelveInstance-460950276 None] Created volume successfully.
Sep 18 12:08:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-6f99d06d-5cac-44d0-b289-e247fa969061 req-040be075-66da-4770-877b-f2e50f87a299 tempest-TestShelveInstance-460950276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:08:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-6f99d06d-5cac-44d0-b289-e247fa969061 req-040be075-66da-4770-877b-f2e50f87a299 tempest-TestShelveInstance-460950276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:08:41 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b9cbb8-1692-46e7-947d-db2340acbf2e]: (4, 'raw') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:08:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-6f99d06d-5cac-44d0-b289-e247fa969061 req-040be075-66da-4770-877b-f2e50f87a299 tempest-TestShelveInstance-460950276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a2e204c8-f90e-470e-bff3-bef38a37d760 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:08:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-6f99d06d-5cac-44d0-b289-e247fa969061 req-040be075-66da-4770-877b-f2e50f87a299 tempest-TestShelveInstance-460950276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a2e204c8-f90e-470e-bff3-bef38a37d760" returned: 0 in 0.446s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:08:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-6f99d06d-5cac-44d0-b289-e247fa969061 req-040be075-66da-4770-877b-f2e50f87a299 tempest-TestShelveInstance-460950276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a2e204c8-f90e-470e-bff3-bef38a37d760 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:08:42 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-6f99d06d-5cac-44d0-b289-e247fa969061 req-040be075-66da-4770-877b-f2e50f87a299 tempest-TestShelveInstance-460950276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a2e204c8-f90e-470e-bff3-bef38a37d760" returned: 1 in 0.409s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:08:42 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-6f99d06d-5cac-44d0-b289-e247fa969061 req-040be075-66da-4770-877b-f2e50f87a299 tempest-TestShelveInstance-460950276 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a2e204c8-f90e-470e-bff3-bef38a37d760' failed. Not Retrying. {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 12:08:42 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-6f99d06d-5cac-44d0-b289-e247fa969061 req-040be075-66da-4770-877b-f2e50f87a299 tempest-TestShelveInstance-460950276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.969s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:08:42 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-6f99d06d-5cac-44d0-b289-e247fa969061 req-040be075-66da-4770-877b-f2e50f87a299 tempest-TestShelveInstance-460950276 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8', 'name': 'volume-a2e204c8-f90e-470e-bff3-bef38a37d760', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ffe446f3-ec80-4290-8a0f-e9fd975e3ab5', 'enforce_multipath': True} {{(pid=83176) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 12:08:42 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-6f99d06d-5cac-44d0-b289-e247fa969061 req-040be075-66da-4770-877b-f2e50f87a299 tempest-TestShelveInstance-460950276 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:08:42 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-6f99d06d-5cac-44d0-b289-e247fa969061 req-040be075-66da-4770-877b-f2e50f87a299 tempest-TestShelveInstance-460950276 None] attachment_update completed successfully.
Sep 18 12:08:52 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:UPDATE=5,cinder:SELECT=11,cinder:INSERT=10,cinder:DELETE=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 12:08:52 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=18,cinder:INSERT=3,cinder:UPDATE=6 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 12:09:14 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 12:09:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:09:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:09:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:09:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:09:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:09:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:09:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.099s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:09:14 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:10:13 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-419ffc7f-4e99-42c1-a67f-1361ca288980 req-3ed3b3e5-f981-4031-a6c0-b9175aa1f28c tempest-TestShelveInstance-460950276 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:10:13 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-419ffc7f-4e99-42c1-a67f-1361ca288980 req-3ed3b3e5-f981-4031-a6c0-b9175aa1f28c tempest-TestShelveInstance-460950276 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:10:13 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-419ffc7f-4e99-42c1-a67f-1361ca288980 req-3ed3b3e5-f981-4031-a6c0-b9175aa1f28c tempest-TestShelveInstance-460950276 None] Terminate volume connection completed successfully.
Sep 18 12:10:13 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-419ffc7f-4e99-42c1-a67f-1361ca288980 req-3ed3b3e5-f981-4031-a6c0-b9175aa1f28c tempest-TestShelveInstance-460950276 None] Deleting attachment ffe446f3-ec80-4290-8a0f-e9fd975e3ab5. {{(pid=83176) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 12:10:14 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 12:10:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:10:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:10:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:10:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:10:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:10:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:10:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.133s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:10:14 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:10:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-4402b741-32a0-4dd8-a54a-d9e3d8af11ce req-a6a330d9-381f-4a16-9ee6-ec196371879e tempest-TestShelveInstance-460950276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:10:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-4402b741-32a0-4dd8-a54a-d9e3d8af11ce req-a6a330d9-381f-4a16-9ee6-ec196371879e tempest-TestShelveInstance-460950276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:10:19 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1f55bb-e5d4-4b11-9b4a-e1d1f402df96]: (4, 'raw') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:10:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-4402b741-32a0-4dd8-a54a-d9e3d8af11ce req-a6a330d9-381f-4a16-9ee6-ec196371879e tempest-TestShelveInstance-460950276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a2e204c8-f90e-470e-bff3-bef38a37d760 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:10:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-4402b741-32a0-4dd8-a54a-d9e3d8af11ce req-a6a330d9-381f-4a16-9ee6-ec196371879e tempest-TestShelveInstance-460950276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a2e204c8-f90e-470e-bff3-bef38a37d760" returned: 0 in 0.401s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:10:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-4402b741-32a0-4dd8-a54a-d9e3d8af11ce req-a6a330d9-381f-4a16-9ee6-ec196371879e tempest-TestShelveInstance-460950276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a2e204c8-f90e-470e-bff3-bef38a37d760 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:10:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-4402b741-32a0-4dd8-a54a-d9e3d8af11ce req-a6a330d9-381f-4a16-9ee6-ec196371879e tempest-TestShelveInstance-460950276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a2e204c8-f90e-470e-bff3-bef38a37d760" returned: 1 in 0.390s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:10:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-4402b741-32a0-4dd8-a54a-d9e3d8af11ce req-a6a330d9-381f-4a16-9ee6-ec196371879e tempest-TestShelveInstance-460950276 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a2e204c8-f90e-470e-bff3-bef38a37d760' failed. Not Retrying. {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 12:10:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-4402b741-32a0-4dd8-a54a-d9e3d8af11ce req-a6a330d9-381f-4a16-9ee6-ec196371879e tempest-TestShelveInstance-460950276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.990s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:10:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-4402b741-32a0-4dd8-a54a-d9e3d8af11ce req-a6a330d9-381f-4a16-9ee6-ec196371879e tempest-TestShelveInstance-460950276 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8', 'name': 'volume-a2e204c8-f90e-470e-bff3-bef38a37d760', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'daddfebc-870d-41f5-87e7-bf6d8076bd66', 'enforce_multipath': True} {{(pid=83176) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 12:10:20 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-4402b741-32a0-4dd8-a54a-d9e3d8af11ce req-a6a330d9-381f-4a16-9ee6-ec196371879e tempest-TestShelveInstance-460950276 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:10:20 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-4402b741-32a0-4dd8-a54a-d9e3d8af11ce req-a6a330d9-381f-4a16-9ee6-ec196371879e tempest-TestShelveInstance-460950276 None] attachment_update completed successfully.
Sep 18 12:10:30 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 12:10:30 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 12:10:43 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 12:11:14 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 12:11:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:11:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:11:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:11:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:11:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:11:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:11:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.080s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:11:14 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:11:51 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-180d8a3b-3f8e-4d76-834a-13b1aa880851 req-4d70d5f8-008f-4ed7-bb58-a79f612ca06a tempest-TestShelveInstance-460950276 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:11:51 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-180d8a3b-3f8e-4d76-834a-13b1aa880851 req-4d70d5f8-008f-4ed7-bb58-a79f612ca06a tempest-TestShelveInstance-460950276 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:11:51 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-180d8a3b-3f8e-4d76-834a-13b1aa880851 req-4d70d5f8-008f-4ed7-bb58-a79f612ca06a tempest-TestShelveInstance-460950276 None] Terminate volume connection completed successfully.
Sep 18 12:11:51 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [req-180d8a3b-3f8e-4d76-834a-13b1aa880851 req-4d70d5f8-008f-4ed7-bb58-a79f612ca06a tempest-TestShelveInstance-460950276 None] Deleting attachment daddfebc-870d-41f5-87e7-bf6d8076bd66. {{(pid=83176) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 12:11:52 devstack cinder-volume[83176]: DEBUG cinder.coordination [req-180d8a3b-3f8e-4d76-834a-13b1aa880851 req-c63b7753-28db-4cf7-9f39-25d9382da1a2 tempest-TestShelveInstance-460950276 None] Acquiring lock "cinder-a2e204c8-f90e-470e-bff3-bef38a37d760-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:11:52 devstack cinder-volume[83176]: DEBUG cinder.coordination [req-180d8a3b-3f8e-4d76-834a-13b1aa880851 req-c63b7753-28db-4cf7-9f39-25d9382da1a2 tempest-TestShelveInstance-460950276 None] Lock "cinder-a2e204c8-f90e-470e-bff3-bef38a37d760-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:11:52 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [req-180d8a3b-3f8e-4d76-834a-13b1aa880851 req-c63b7753-28db-4cf7-9f39-25d9382da1a2 tempest-TestShelveInstance-460950276 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:11:52 devstack cinder-volume[83176]: DEBUG cinder.coordination [req-180d8a3b-3f8e-4d76-834a-13b1aa880851 req-c63b7753-28db-4cf7-9f39-25d9382da1a2 tempest-TestShelveInstance-460950276 None] Acquiring lock "cinder-quobyte-a2e204c8-f90e-470e-bff3-bef38a37d760" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:11:52 devstack cinder-volume[83176]: DEBUG cinder.coordination [req-180d8a3b-3f8e-4d76-834a-13b1aa880851 req-c63b7753-28db-4cf7-9f39-25d9382da1a2 tempest-TestShelveInstance-460950276 None] Lock "cinder-quobyte-a2e204c8-f90e-470e-bff3-bef38a37d760" acquired by "delete_volume" :: waited 0.011s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:11:52 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[87880b5e-d73f-40e6-81a8-0536181e67db]: (4, 'raw') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:11:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-180d8a3b-3f8e-4d76-834a-13b1aa880851 req-c63b7753-28db-4cf7-9f39-25d9382da1a2 tempest-TestShelveInstance-460950276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a2e204c8-f90e-470e-bff3-bef38a37d760 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:11:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-180d8a3b-3f8e-4d76-834a-13b1aa880851 req-c63b7753-28db-4cf7-9f39-25d9382da1a2 tempest-TestShelveInstance-460950276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a2e204c8-f90e-470e-bff3-bef38a37d760" returned: 0 in 0.379s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:11:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-180d8a3b-3f8e-4d76-834a-13b1aa880851 req-c63b7753-28db-4cf7-9f39-25d9382da1a2 tempest-TestShelveInstance-460950276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a2e204c8-f90e-470e-bff3-bef38a37d760 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:11:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-180d8a3b-3f8e-4d76-834a-13b1aa880851 req-c63b7753-28db-4cf7-9f39-25d9382da1a2 tempest-TestShelveInstance-460950276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a2e204c8-f90e-470e-bff3-bef38a37d760" returned: 1 in 0.394s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:11:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-180d8a3b-3f8e-4d76-834a-13b1aa880851 req-c63b7753-28db-4cf7-9f39-25d9382da1a2 tempest-TestShelveInstance-460950276 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a2e204c8-f90e-470e-bff3-bef38a37d760' failed. Not Retrying. {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 12:11:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-180d8a3b-3f8e-4d76-834a-13b1aa880851 req-c63b7753-28db-4cf7-9f39-25d9382da1a2 tempest-TestShelveInstance-460950276 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a2e204c8-f90e-470e-bff3-bef38a37d760 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:11:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-180d8a3b-3f8e-4d76-834a-13b1aa880851 req-c63b7753-28db-4cf7-9f39-25d9382da1a2 tempest-TestShelveInstance-460950276 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a2e204c8-f90e-470e-bff3-bef38a37d760" returned: 0 in 0.106s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:11:53 devstack cinder-volume[83176]: DEBUG cinder.coordination [req-180d8a3b-3f8e-4d76-834a-13b1aa880851 req-c63b7753-28db-4cf7-9f39-25d9382da1a2 tempest-TestShelveInstance-460950276 None] Lock "cinder-quobyte-a2e204c8-f90e-470e-bff3-bef38a37d760" released by "delete_volume" :: held 1.149s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:11:53 devstack cinder-volume[83176]: DEBUG cinder.quota [req-180d8a3b-3f8e-4d76-834a-13b1aa880851 req-c63b7753-28db-4cf7-9f39-25d9382da1a2 tempest-TestShelveInstance-460950276 None] Created reservations ['8bd29593-9db3-4f07-a970-cf6470ec7add', '723605c8-0c9e-4b16-a3e3-f5ad43cd9d5f', 'dea9435a-a252-4a88-8ccd-f30bf28bdd54', 'a900f03b-7705-4e64-a8be-44c73f071042'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:11:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-180d8a3b-3f8e-4d76-834a-13b1aa880851 req-c63b7753-28db-4cf7-9f39-25d9382da1a2 tempest-TestShelveInstance-460950276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:11:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-180d8a3b-3f8e-4d76-834a-13b1aa880851 req-c63b7753-28db-4cf7-9f39-25d9382da1a2 tempest-TestShelveInstance-460950276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:11:53 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [req-180d8a3b-3f8e-4d76-834a-13b1aa880851 req-c63b7753-28db-4cf7-9f39-25d9382da1a2 tempest-TestShelveInstance-460950276 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:11:53 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [req-180d8a3b-3f8e-4d76-834a-13b1aa880851 req-c63b7753-28db-4cf7-9f39-25d9382da1a2 tempest-TestShelveInstance-460950276 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:11:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [req-180d8a3b-3f8e-4d76-834a-13b1aa880851 req-c63b7753-28db-4cf7-9f39-25d9382da1a2 tempest-TestShelveInstance-460950276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:11:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-180d8a3b-3f8e-4d76-834a-13b1aa880851 req-c63b7753-28db-4cf7-9f39-25d9382da1a2 tempest-TestShelveInstance-460950276 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:11:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [req-180d8a3b-3f8e-4d76-834a-13b1aa880851 req-c63b7753-28db-4cf7-9f39-25d9382da1a2 tempest-TestShelveInstance-460950276 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.092s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:11:54 devstack cinder-volume[83176]: DEBUG cinder.manager [req-180d8a3b-3f8e-4d76-834a-13b1aa880851 req-c63b7753-28db-4cf7-9f39-25d9382da1a2 tempest-TestShelveInstance-460950276 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:11:54 devstack cinder-volume[83176]: INFO cinder.volume.manager [req-180d8a3b-3f8e-4d76-834a-13b1aa880851 req-c63b7753-28db-4cf7-9f39-25d9382da1a2 tempest-TestShelveInstance-460950276 None] Deleted volume successfully.
Sep 18 12:11:54 devstack cinder-volume[83176]: DEBUG cinder.coordination [req-180d8a3b-3f8e-4d76-834a-13b1aa880851 req-c63b7753-28db-4cf7-9f39-25d9382da1a2 tempest-TestShelveInstance-460950276 None] Lock "cinder-a2e204c8-f90e-470e-bff3-bef38a37d760-delete_volume" released by "delete_volume" :: held 1.985s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:12:03 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=5,cinder:UPDATE=8,cinder:INSERT=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 12:12:04 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=7,cinder:INSERT=3,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 12:12:09 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-eb8fe918-2be3-456e-a42d-6333eaa26240 tempest-CreateVolumesFromSnapshotTest-958873287 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:12:09 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb8fe918-2be3-456e-a42d-6333eaa26240 tempest-CreateVolumesFromSnapshotTest-958873287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 12:12:09 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-eb8fe918-2be3-456e-a42d-6333eaa26240 tempest-CreateVolumesFromSnapshotTest-958873287 None] Flow 'volume_create_manager' (e16fc830-13e1-49e4-bece-6c637480661d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:12:09 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-eb8fe918-2be3-456e-a42d-6333eaa26240 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd12ca77-2349-4999-b420-7fb7d0aa90e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:09 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-eb8fe918-2be3-456e-a42d-6333eaa26240 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd12ca77-2349-4999-b420-7fb7d0aa90e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-18957589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3b12a2a-6f34-4387-953a-a2d0cb1ea477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8dd1b7fc4184f4298bdeb49ed85f5e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:12:09Z,use_quota=True,user_id='de03bab7e17b4ac99ffc1e5be1652cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:09 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-eb8fe918-2be3-456e-a42d-6333eaa26240 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ca2ead9-42a2-4fcb-94ee-7a12db47fce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:09 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-eb8fe918-2be3-456e-a42d-6333eaa26240 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ca2ead9-42a2-4fcb-94ee-7a12db47fce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:09 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-eb8fe918-2be3-456e-a42d-6333eaa26240 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (880cf5b7-6375-4abf-a34a-db214943b335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:09 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-eb8fe918-2be3-456e-a42d-6333eaa26240 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (880cf5b7-6375-4abf-a34a-db214943b335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3b12a2a-6f34-4387-953a-a2d0cb1ea477', 'volume_name': 'volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:09 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-eb8fe918-2be3-456e-a42d-6333eaa26240 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55c5c567-c9eb-44fd-9c5f-cf565d114026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:09 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-eb8fe918-2be3-456e-a42d-6333eaa26240 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55c5c567-c9eb-44fd-9c5f-cf565d114026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:09 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-eb8fe918-2be3-456e-a42d-6333eaa26240 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (207ea900-ece3-4411-ba3c-8d75d6417908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:09 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-eb8fe918-2be3-456e-a42d-6333eaa26240 tempest-CreateVolumesFromSnapshotTest-958873287 None] Volume f3b12a2a-6f34-4387-953a-a2d0cb1ea477: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477', 'volume_size': 1}
Sep 18 12:12:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-eb8fe918-2be3-456e-a42d-6333eaa26240 tempest-CreateVolumesFromSnapshotTest-958873287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:12:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-eb8fe918-2be3-456e-a42d-6333eaa26240 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:12:09 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-eb8fe918-2be3-456e-a42d-6333eaa26240 tempest-CreateVolumesFromSnapshotTest-958873287 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-18957589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3b12a2a-6f34-4387-953a-a2d0cb1ea477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8dd1b7fc4184f4298bdeb49ed85f5e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:12:09Z,use_quota=True,user_id='de03bab7e17b4ac99ffc1e5be1652cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 12:12:09 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-eb8fe918-2be3-456e-a42d-6333eaa26240 tempest-CreateVolumesFromSnapshotTest-958873287 None] Creating volume f3b12a2a-6f34-4387-953a-a2d0cb1ea477 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 12:12:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-eb8fe918-2be3-456e-a42d-6333eaa26240 tempest-CreateVolumesFromSnapshotTest-958873287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:12:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-eb8fe918-2be3-456e-a42d-6333eaa26240 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:12:09 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-eb8fe918-2be3-456e-a42d-6333eaa26240 tempest-CreateVolumesFromSnapshotTest-958873287 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:12:09 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-eb8fe918-2be3-456e-a42d-6333eaa26240 tempest-CreateVolumesFromSnapshotTest-958873287 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:12:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-eb8fe918-2be3-456e-a42d-6333eaa26240 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:12:09 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-eb8fe918-2be3-456e-a42d-6333eaa26240 tempest-CreateVolumesFromSnapshotTest-958873287 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 12:12:09 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-eb8fe918-2be3-456e-a42d-6333eaa26240 tempest-CreateVolumesFromSnapshotTest-958873287 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 12:12:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-eb8fe918-2be3-456e-a42d-6333eaa26240 tempest-CreateVolumesFromSnapshotTest-958873287 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:09 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=138, name=volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:12:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-eb8fe918-2be3-456e-a42d-6333eaa26240 tempest-CreateVolumesFromSnapshotTest-958873287 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477 1073741824" returned: 0 in 0.319s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-eb8fe918-2be3-456e-a42d-6333eaa26240 tempest-CreateVolumesFromSnapshotTest-958873287 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-eb8fe918-2be3-456e-a42d-6333eaa26240 tempest-CreateVolumesFromSnapshotTest-958873287 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477" returned: 0 in 0.081s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:10 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-eb8fe918-2be3-456e-a42d-6333eaa26240 tempest-CreateVolumesFromSnapshotTest-958873287 None] <== create_volume: return (458ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 12:12:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-eb8fe918-2be3-456e-a42d-6333eaa26240 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.469s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:12:10 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-eb8fe918-2be3-456e-a42d-6333eaa26240 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (207ea900-ece3-4411-ba3c-8d75d6417908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:10 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-eb8fe918-2be3-456e-a42d-6333eaa26240 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7c3da91-8b75-4153-ac86-cfeb46b7a927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:10 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-eb8fe918-2be3-456e-a42d-6333eaa26240 tempest-CreateVolumesFromSnapshotTest-958873287 None] Volume volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477 (f3b12a2a-6f34-4387-953a-a2d0cb1ea477): created successfully
Sep 18 12:12:10 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-eb8fe918-2be3-456e-a42d-6333eaa26240 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7c3da91-8b75-4153-ac86-cfeb46b7a927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:10 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-eb8fe918-2be3-456e-a42d-6333eaa26240 tempest-CreateVolumesFromSnapshotTest-958873287 None] Flow 'volume_create_manager' (e16fc830-13e1-49e4-bece-6c637480661d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:12:10 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-eb8fe918-2be3-456e-a42d-6333eaa26240 tempest-CreateVolumesFromSnapshotTest-958873287 None] Created volume successfully.
Sep 18 12:12:11 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-1e87881f-2c38-42dc-bacd-478c38176ce7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:12:11 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1e87881f-2c38-42dc-bacd-478c38176ce7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:12:11 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1e87881f-2c38-42dc-bacd-478c38176ce7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:12:11 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-1e87881f-2c38-42dc-bacd-478c38176ce7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Creating offline snapshot 723b6e38-cfed-4be9-9d1a-8d8b6623f2a4 of volume f3b12a2a-6f34-4387-953a-a2d0cb1ea477 {{(pid=83176) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 12:12:12 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e99dd2f-6b4c-4736-802f-2dd0d972955e]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:12:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1e87881f-2c38-42dc-bacd-478c38176ce7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1e87881f-2c38-42dc-bacd-478c38176ce7 tempest-CreateVolumesFromSnapshotTest-958873287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477" returned: 0 in 0.390s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1e87881f-2c38-42dc-bacd-478c38176ce7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477.723b6e38-cfed-4be9-9d1a-8d8b6623f2a4 1G {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:12 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=139, name=volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477.723b6e38-cfed-4be9-9d1a-8d8b6623f2a4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:12:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1e87881f-2c38-42dc-bacd-478c38176ce7 tempest-CreateVolumesFromSnapshotTest-958873287 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477.723b6e38-cfed-4be9-9d1a-8d8b6623f2a4 1G" returned: 0 in 0.217s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1e87881f-2c38-42dc-bacd-478c38176ce7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Running cmd (subprocess): qemu-img rebase -u -b volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477 -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477.723b6e38-cfed-4be9-9d1a-8d8b6623f2a4 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1e87881f-2c38-42dc-bacd-478c38176ce7 tempest-CreateVolumesFromSnapshotTest-958873287 None] CMD "qemu-img rebase -u -b volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477 -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477.723b6e38-cfed-4be9-9d1a-8d8b6623f2a4" returned: 0 in 0.118s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:12 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-1e87881f-2c38-42dc-bacd-478c38176ce7 tempest-CreateVolumesFromSnapshotTest-958873287 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477.723b6e38-cfed-4be9-9d1a-8d8b6623f2a4 is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 12:12:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1e87881f-2c38-42dc-bacd-478c38176ce7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477.723b6e38-cfed-4be9-9d1a-8d8b6623f2a4 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1e87881f-2c38-42dc-bacd-478c38176ce7 tempest-CreateVolumesFromSnapshotTest-958873287 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477.723b6e38-cfed-4be9-9d1a-8d8b6623f2a4" returned: 0 in 0.091s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:12 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-1e87881f-2c38-42dc-bacd-478c38176ce7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Setting permissions: /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477 -> 1000:1000 {{(pid=83176) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 12:12:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1e87881f-2c38-42dc-bacd-478c38176ce7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477.723b6e38-cfed-4be9-9d1a-8d8b6623f2a4 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1e87881f-2c38-42dc-bacd-478c38176ce7 tempest-CreateVolumesFromSnapshotTest-958873287 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477.723b6e38-cfed-4be9-9d1a-8d8b6623f2a4" returned: 0 in 0.095s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1e87881f-2c38-42dc-bacd-478c38176ce7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477.info {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1e87881f-2c38-42dc-bacd-478c38176ce7 tempest-CreateVolumesFromSnapshotTest-958873287 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477.info" returned: 0 in 0.101s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:13 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-1e87881f-2c38-42dc-bacd-478c38176ce7 tempest-CreateVolumesFromSnapshotTest-958873287 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477.info is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 12:12:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1e87881f-2c38-42dc-bacd-478c38176ce7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477.info {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1e87881f-2c38-42dc-bacd-478c38176ce7 tempest-CreateVolumesFromSnapshotTest-958873287 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477.info" returned: 0 in 0.083s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1e87881f-2c38-42dc-bacd-478c38176ce7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.395s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:12:13 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-1e87881f-2c38-42dc-bacd-478c38176ce7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Create snapshot completed successfully
Sep 18 12:12:14 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 12:12:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:12:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:12:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:12:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:12:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:12:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.389s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:14 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:12:14 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-a94cd5bb-4341-4e13-99c5-d02877f26c46 tempest-CreateVolumesFromSnapshotTest-958873287 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:12:14 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-a94cd5bb-4341-4e13-99c5-d02877f26c46 tempest-CreateVolumesFromSnapshotTest-958873287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 12:12:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-a94cd5bb-4341-4e13-99c5-d02877f26c46 tempest-CreateVolumesFromSnapshotTest-958873287 None] Flow 'volume_create_manager' (2306daf1-ae0b-4f3c-8f69-85c2170b86e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:12:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-a94cd5bb-4341-4e13-99c5-d02877f26c46 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66bdf8b1-fc3f-4b88-b7ff-9e3367cde46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-a94cd5bb-4341-4e13-99c5-d02877f26c46 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66bdf8b1-fc3f-4b88-b7ff-9e3367cde46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2067661570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccff635a-9dd1-4462-a82a-0d0878f5dd8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8dd1b7fc4184f4298bdeb49ed85f5e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:12:14Z,use_quota=True,user_id='de03bab7e17b4ac99ffc1e5be1652cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-a94cd5bb-4341-4e13-99c5-d02877f26c46 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8974a0bf-eee0-48e9-af0d-da2a0908f735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-a94cd5bb-4341-4e13-99c5-d02877f26c46 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8974a0bf-eee0-48e9-af0d-da2a0908f735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-a94cd5bb-4341-4e13-99c5-d02877f26c46 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0ad60b4-1f0f-4604-aa47-d2986e8bdcf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-a94cd5bb-4341-4e13-99c5-d02877f26c46 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0ad60b4-1f0f-4604-aa47-d2986e8bdcf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccff635a-9dd1-4462-a82a-0d0878f5dd8c', 'volume_name': 'volume-ccff635a-9dd1-4462-a82a-0d0878f5dd8c', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-a94cd5bb-4341-4e13-99c5-d02877f26c46 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cb212f5-73a6-4599-8818-3c406daca28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-a94cd5bb-4341-4e13-99c5-d02877f26c46 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cb212f5-73a6-4599-8818-3c406daca28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:14 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-a94cd5bb-4341-4e13-99c5-d02877f26c46 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9af6d330-0415-40cb-a8eb-d265dc4319e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:14 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-a94cd5bb-4341-4e13-99c5-d02877f26c46 tempest-CreateVolumesFromSnapshotTest-958873287 None] Volume ccff635a-9dd1-4462-a82a-0d0878f5dd8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccff635a-9dd1-4462-a82a-0d0878f5dd8c', 'volume_size': 1}
Sep 18 12:12:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a94cd5bb-4341-4e13-99c5-d02877f26c46 tempest-CreateVolumesFromSnapshotTest-958873287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:12:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a94cd5bb-4341-4e13-99c5-d02877f26c46 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:12:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a94cd5bb-4341-4e13-99c5-d02877f26c46 tempest-CreateVolumesFromSnapshotTest-958873287 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2067661570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccff635a-9dd1-4462-a82a-0d0878f5dd8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8dd1b7fc4184f4298bdeb49ed85f5e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:12:14Z,use_quota=True,user_id='de03bab7e17b4ac99ffc1e5be1652cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 12:12:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-a94cd5bb-4341-4e13-99c5-d02877f26c46 tempest-CreateVolumesFromSnapshotTest-958873287 None] Creating volume ccff635a-9dd1-4462-a82a-0d0878f5dd8c {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 12:12:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a94cd5bb-4341-4e13-99c5-d02877f26c46 tempest-CreateVolumesFromSnapshotTest-958873287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:12:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a94cd5bb-4341-4e13-99c5-d02877f26c46 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:12:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a94cd5bb-4341-4e13-99c5-d02877f26c46 tempest-CreateVolumesFromSnapshotTest-958873287 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:12:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a94cd5bb-4341-4e13-99c5-d02877f26c46 tempest-CreateVolumesFromSnapshotTest-958873287 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:12:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a94cd5bb-4341-4e13-99c5-d02877f26c46 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:12:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a94cd5bb-4341-4e13-99c5-d02877f26c46 tempest-CreateVolumesFromSnapshotTest-958873287 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 12:12:14 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-a94cd5bb-4341-4e13-99c5-d02877f26c46 tempest-CreateVolumesFromSnapshotTest-958873287 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 12:12:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a94cd5bb-4341-4e13-99c5-d02877f26c46 tempest-CreateVolumesFromSnapshotTest-958873287 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-ccff635a-9dd1-4462-a82a-0d0878f5dd8c 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:15 devstack quobyte-client[83193]: System call of process 100606 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 12:12:15 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=141, name=volume-ccff635a-9dd1-4462-a82a-0d0878f5dd8c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:12:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a94cd5bb-4341-4e13-99c5-d02877f26c46 tempest-CreateVolumesFromSnapshotTest-958873287 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-ccff635a-9dd1-4462-a82a-0d0878f5dd8c 1073741824" returned: 0 in 0.528s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a94cd5bb-4341-4e13-99c5-d02877f26c46 tempest-CreateVolumesFromSnapshotTest-958873287 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-ccff635a-9dd1-4462-a82a-0d0878f5dd8c {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:15 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-d2120dd0-839b-4f59-a65f-50b1ab84bf90 tempest-CreateVolumesFromSnapshotTest-958873287 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:12:15 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2120dd0-839b-4f59-a65f-50b1ab84bf90 tempest-CreateVolumesFromSnapshotTest-958873287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 12:12:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d2120dd0-839b-4f59-a65f-50b1ab84bf90 tempest-CreateVolumesFromSnapshotTest-958873287 None] Flow 'volume_create_manager' (22c95900-d181-4b1c-ac89-5e8ce4fdcef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:12:15 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d2120dd0-839b-4f59-a65f-50b1ab84bf90 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66e4a71e-75db-450d-8710-f95b6e0a7e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:15 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-4b8964aa-712d-4331-9e0b-aee0245e18e1 tempest-CreateVolumesFromSnapshotTest-958873287 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:12:15 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b8964aa-712d-4331-9e0b-aee0245e18e1 tempest-CreateVolumesFromSnapshotTest-958873287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 12:12:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4b8964aa-712d-4331-9e0b-aee0245e18e1 tempest-CreateVolumesFromSnapshotTest-958873287 None] Flow 'volume_create_manager' (0fdd19eb-4417-4d81-be3c-6514d7906fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:12:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4b8964aa-712d-4331-9e0b-aee0245e18e1 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34784587-1823-4479-97db-55a41befdb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d2120dd0-839b-4f59-a65f-50b1ab84bf90 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66e4a71e-75db-450d-8710-f95b6e0a7e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1457827927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d7248e2-24d9-44fe-b74d-8ebc922c6a66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8dd1b7fc4184f4298bdeb49ed85f5e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:12:15Z,use_quota=True,user_id='de03bab7e17b4ac99ffc1e5be1652cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d2120dd0-839b-4f59-a65f-50b1ab84bf90 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b30221f4-f08b-48cb-bd7a-f8713b320dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d2120dd0-839b-4f59-a65f-50b1ab84bf90 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b30221f4-f08b-48cb-bd7a-f8713b320dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d2120dd0-839b-4f59-a65f-50b1ab84bf90 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e2d6126-efe7-4f8e-8dc6-9a3cae4d32b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d2120dd0-839b-4f59-a65f-50b1ab84bf90 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e2d6126-efe7-4f8e-8dc6-9a3cae4d32b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d7248e2-24d9-44fe-b74d-8ebc922c6a66', 'volume_name': 'volume-7d7248e2-24d9-44fe-b74d-8ebc922c6a66', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d2120dd0-839b-4f59-a65f-50b1ab84bf90 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b124115-9cae-499b-92fa-c8dcebaba089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d2120dd0-839b-4f59-a65f-50b1ab84bf90 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b124115-9cae-499b-92fa-c8dcebaba089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d2120dd0-839b-4f59-a65f-50b1ab84bf90 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bd5af15-c8f7-4134-a972-c1f0f9b837ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:16 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-d2120dd0-839b-4f59-a65f-50b1ab84bf90 tempest-CreateVolumesFromSnapshotTest-958873287 None] Volume 7d7248e2-24d9-44fe-b74d-8ebc922c6a66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d7248e2-24d9-44fe-b74d-8ebc922c6a66', 'volume_size': 1}
Sep 18 12:12:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d2120dd0-839b-4f59-a65f-50b1ab84bf90 tempest-CreateVolumesFromSnapshotTest-958873287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:12:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a94cd5bb-4341-4e13-99c5-d02877f26c46 tempest-CreateVolumesFromSnapshotTest-958873287 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-ccff635a-9dd1-4462-a82a-0d0878f5dd8c" returned: 0 in 0.619s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:16 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a94cd5bb-4341-4e13-99c5-d02877f26c46 tempest-CreateVolumesFromSnapshotTest-958873287 None] <== create_volume: return (1173ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 12:12:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a94cd5bb-4341-4e13-99c5-d02877f26c46 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:12:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d2120dd0-839b-4f59-a65f-50b1ab84bf90 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.038s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:12:16 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-d2120dd0-839b-4f59-a65f-50b1ab84bf90 tempest-CreateVolumesFromSnapshotTest-958873287 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1457827927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d7248e2-24d9-44fe-b74d-8ebc922c6a66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8dd1b7fc4184f4298bdeb49ed85f5e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:12:15Z,use_quota=True,user_id='de03bab7e17b4ac99ffc1e5be1652cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 12:12:16 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-d2120dd0-839b-4f59-a65f-50b1ab84bf90 tempest-CreateVolumesFromSnapshotTest-958873287 None] Creating volume 7d7248e2-24d9-44fe-b74d-8ebc922c6a66 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 12:12:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d2120dd0-839b-4f59-a65f-50b1ab84bf90 tempest-CreateVolumesFromSnapshotTest-958873287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:12:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d2120dd0-839b-4f59-a65f-50b1ab84bf90 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:12:16 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-d2120dd0-839b-4f59-a65f-50b1ab84bf90 tempest-CreateVolumesFromSnapshotTest-958873287 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:12:16 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-d2120dd0-839b-4f59-a65f-50b1ab84bf90 tempest-CreateVolumesFromSnapshotTest-958873287 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:12:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d2120dd0-839b-4f59-a65f-50b1ab84bf90 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:12:16 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-d2120dd0-839b-4f59-a65f-50b1ab84bf90 tempest-CreateVolumesFromSnapshotTest-958873287 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 12:12:16 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-d2120dd0-839b-4f59-a65f-50b1ab84bf90 tempest-CreateVolumesFromSnapshotTest-958873287 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 12:12:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d2120dd0-839b-4f59-a65f-50b1ab84bf90 tempest-CreateVolumesFromSnapshotTest-958873287 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-7d7248e2-24d9-44fe-b74d-8ebc922c6a66 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:16 devstack quobyte-client[83193]: System call of process 100610 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 12:12:16 devstack quobyte-client[83193]: System call of process 100610 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 12:12:16 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=142, name=volume-7d7248e2-24d9-44fe-b74d-8ebc922c6a66, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:12:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4b8964aa-712d-4331-9e0b-aee0245e18e1 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34784587-1823-4479-97db-55a41befdb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-584889635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1975e859-1929-46e3-ad87-9fe257242b44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8dd1b7fc4184f4298bdeb49ed85f5e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:12:15Z,use_quota=True,user_id='de03bab7e17b4ac99ffc1e5be1652cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4b8964aa-712d-4331-9e0b-aee0245e18e1 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84ef58ab-276f-45ed-80e6-c1dc62c61f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4b8964aa-712d-4331-9e0b-aee0245e18e1 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84ef58ab-276f-45ed-80e6-c1dc62c61f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4b8964aa-712d-4331-9e0b-aee0245e18e1 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7d03b39-785e-43a4-94e0-093987a3148f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4b8964aa-712d-4331-9e0b-aee0245e18e1 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7d03b39-785e-43a4-94e0-093987a3148f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1975e859-1929-46e3-ad87-9fe257242b44', 'volume_name': 'volume-1975e859-1929-46e3-ad87-9fe257242b44', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4b8964aa-712d-4331-9e0b-aee0245e18e1 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee25a736-719b-4e36-b11e-72a83a7dd46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4b8964aa-712d-4331-9e0b-aee0245e18e1 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee25a736-719b-4e36-b11e-72a83a7dd46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4b8964aa-712d-4331-9e0b-aee0245e18e1 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5d41cee-1422-45da-824b-68e635c5a1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:16 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-4b8964aa-712d-4331-9e0b-aee0245e18e1 tempest-CreateVolumesFromSnapshotTest-958873287 None] Volume 1975e859-1929-46e3-ad87-9fe257242b44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1975e859-1929-46e3-ad87-9fe257242b44', 'volume_size': 1}
Sep 18 12:12:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4b8964aa-712d-4331-9e0b-aee0245e18e1 tempest-CreateVolumesFromSnapshotTest-958873287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:12:16 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-74cc4959-3f3d-4c1b-879e-2725ba9c4333 tempest-CreateVolumesFromSnapshotTest-958873287 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:12:16 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-74cc4959-3f3d-4c1b-879e-2725ba9c4333 tempest-CreateVolumesFromSnapshotTest-958873287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 12:12:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-74cc4959-3f3d-4c1b-879e-2725ba9c4333 tempest-CreateVolumesFromSnapshotTest-958873287 None] Flow 'volume_create_manager' (a49f7ec9-50ea-418a-83ee-6a3e656ae9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:12:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-74cc4959-3f3d-4c1b-879e-2725ba9c4333 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e0de23f-cee3-432e-ab48-ce8a44e2bf29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-a94cd5bb-4341-4e13-99c5-d02877f26c46 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9af6d330-0415-40cb-a8eb-d265dc4319e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccff635a-9dd1-4462-a82a-0d0878f5dd8c', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-a94cd5bb-4341-4e13-99c5-d02877f26c46 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebd08e05-dac5-4280-9524-2a3d370fd05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d2120dd0-839b-4f59-a65f-50b1ab84bf90 tempest-CreateVolumesFromSnapshotTest-958873287 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-7d7248e2-24d9-44fe-b74d-8ebc922c6a66 1073741824" returned: 0 in 0.557s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d2120dd0-839b-4f59-a65f-50b1ab84bf90 tempest-CreateVolumesFromSnapshotTest-958873287 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-7d7248e2-24d9-44fe-b74d-8ebc922c6a66 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:16 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-a94cd5bb-4341-4e13-99c5-d02877f26c46 tempest-CreateVolumesFromSnapshotTest-958873287 None] Volume volume-ccff635a-9dd1-4462-a82a-0d0878f5dd8c (ccff635a-9dd1-4462-a82a-0d0878f5dd8c): created successfully
Sep 18 12:12:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-a94cd5bb-4341-4e13-99c5-d02877f26c46 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebd08e05-dac5-4280-9524-2a3d370fd05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-a94cd5bb-4341-4e13-99c5-d02877f26c46 tempest-CreateVolumesFromSnapshotTest-958873287 None] Flow 'volume_create_manager' (2306daf1-ae0b-4f3c-8f69-85c2170b86e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-74cc4959-3f3d-4c1b-879e-2725ba9c4333 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e0de23f-cee3-432e-ab48-ce8a44e2bf29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1486069668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f21a259b-43f1-4f36-9e86-5dc0fb86a855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8dd1b7fc4184f4298bdeb49ed85f5e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:12:16Z,use_quota=True,user_id='de03bab7e17b4ac99ffc1e5be1652cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-74cc4959-3f3d-4c1b-879e-2725ba9c4333 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5860dddc-9899-46bc-aa1b-13fdb40ad6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-74cc4959-3f3d-4c1b-879e-2725ba9c4333 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5860dddc-9899-46bc-aa1b-13fdb40ad6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-74cc4959-3f3d-4c1b-879e-2725ba9c4333 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcd54ef9-c38f-4354-a22a-2d0adddf4592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-74cc4959-3f3d-4c1b-879e-2725ba9c4333 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcd54ef9-c38f-4354-a22a-2d0adddf4592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f21a259b-43f1-4f36-9e86-5dc0fb86a855', 'volume_name': 'volume-f21a259b-43f1-4f36-9e86-5dc0fb86a855', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-74cc4959-3f3d-4c1b-879e-2725ba9c4333 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c63f4900-bd62-41af-b5b6-979130464416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-74cc4959-3f3d-4c1b-879e-2725ba9c4333 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c63f4900-bd62-41af-b5b6-979130464416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-74cc4959-3f3d-4c1b-879e-2725ba9c4333 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20fbbe35-3a8a-4f47-8aa7-e747d39593b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:17 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-74cc4959-3f3d-4c1b-879e-2725ba9c4333 tempest-CreateVolumesFromSnapshotTest-958873287 None] Volume f21a259b-43f1-4f36-9e86-5dc0fb86a855: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f21a259b-43f1-4f36-9e86-5dc0fb86a855', 'volume_size': 1}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-74cc4959-3f3d-4c1b-879e-2725ba9c4333 tempest-CreateVolumesFromSnapshotTest-958873287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:12:17 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-a94cd5bb-4341-4e13-99c5-d02877f26c46 tempest-CreateVolumesFromSnapshotTest-958873287 None] Created volume successfully.
Sep 18 12:12:17 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-fdb2d509-6bbb-4e54-b497-6381247d29a7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdb2d509-6bbb-4e54-b497-6381247d29a7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-fdb2d509-6bbb-4e54-b497-6381247d29a7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Flow 'volume_create_manager' (1f899302-6dfa-4b02-834c-57b7444208be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-fdb2d509-6bbb-4e54-b497-6381247d29a7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (547d134f-da27-4006-969a-256e570e4108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d2120dd0-839b-4f59-a65f-50b1ab84bf90 tempest-CreateVolumesFromSnapshotTest-958873287 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-7d7248e2-24d9-44fe-b74d-8ebc922c6a66" returned: 0 in 0.472s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-d2120dd0-839b-4f59-a65f-50b1ab84bf90 tempest-CreateVolumesFromSnapshotTest-958873287 None] <== create_volume: return (1053ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d2120dd0-839b-4f59-a65f-50b1ab84bf90 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4b8964aa-712d-4331-9e0b-aee0245e18e1 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.664s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-4b8964aa-712d-4331-9e0b-aee0245e18e1 tempest-CreateVolumesFromSnapshotTest-958873287 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-584889635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1975e859-1929-46e3-ad87-9fe257242b44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8dd1b7fc4184f4298bdeb49ed85f5e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:12:15Z,use_quota=True,user_id='de03bab7e17b4ac99ffc1e5be1652cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-4b8964aa-712d-4331-9e0b-aee0245e18e1 tempest-CreateVolumesFromSnapshotTest-958873287 None] Creating volume 1975e859-1929-46e3-ad87-9fe257242b44 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4b8964aa-712d-4331-9e0b-aee0245e18e1 tempest-CreateVolumesFromSnapshotTest-958873287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4b8964aa-712d-4331-9e0b-aee0245e18e1 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-4b8964aa-712d-4331-9e0b-aee0245e18e1 tempest-CreateVolumesFromSnapshotTest-958873287 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-4b8964aa-712d-4331-9e0b-aee0245e18e1 tempest-CreateVolumesFromSnapshotTest-958873287 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4b8964aa-712d-4331-9e0b-aee0245e18e1 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-4b8964aa-712d-4331-9e0b-aee0245e18e1 tempest-CreateVolumesFromSnapshotTest-958873287 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 12:12:17 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-4b8964aa-712d-4331-9e0b-aee0245e18e1 tempest-CreateVolumesFromSnapshotTest-958873287 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4b8964aa-712d-4331-9e0b-aee0245e18e1 tempest-CreateVolumesFromSnapshotTest-958873287 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1975e859-1929-46e3-ad87-9fe257242b44 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:17 devstack quobyte-client[83193]: System call of process 100615 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 12:12:17 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=143, name=volume-1975e859-1929-46e3-ad87-9fe257242b44, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-fdb2d509-6bbb-4e54-b497-6381247d29a7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (547d134f-da27-4006-969a-256e570e4108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-40398266',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5d7f000-e027-413c-a383-9cbb769d1c28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8dd1b7fc4184f4298bdeb49ed85f5e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:12:16Z,use_quota=True,user_id='de03bab7e17b4ac99ffc1e5be1652cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-fdb2d509-6bbb-4e54-b497-6381247d29a7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (088e8933-56ab-42f8-837b-385382842e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-fdb2d509-6bbb-4e54-b497-6381247d29a7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (088e8933-56ab-42f8-837b-385382842e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-fdb2d509-6bbb-4e54-b497-6381247d29a7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd601d85-b613-4a8e-85c3-33ce5c294fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-fdb2d509-6bbb-4e54-b497-6381247d29a7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd601d85-b613-4a8e-85c3-33ce5c294fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5d7f000-e027-413c-a383-9cbb769d1c28', 'volume_name': 'volume-e5d7f000-e027-413c-a383-9cbb769d1c28', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-fdb2d509-6bbb-4e54-b497-6381247d29a7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f5c77e1-3c29-44a0-9bc6-af609ce5ca0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-fdb2d509-6bbb-4e54-b497-6381247d29a7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f5c77e1-3c29-44a0-9bc6-af609ce5ca0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-fdb2d509-6bbb-4e54-b497-6381247d29a7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4008a7e6-565b-4bf8-8531-cd4caab77f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:17 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-fdb2d509-6bbb-4e54-b497-6381247d29a7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Volume e5d7f000-e027-413c-a383-9cbb769d1c28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5d7f000-e027-413c-a383-9cbb769d1c28', 'volume_size': 1}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-fdb2d509-6bbb-4e54-b497-6381247d29a7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d2120dd0-839b-4f59-a65f-50b1ab84bf90 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bd5af15-c8f7-4134-a972-c1f0f9b837ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d7248e2-24d9-44fe-b74d-8ebc922c6a66', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d2120dd0-839b-4f59-a65f-50b1ab84bf90 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eca2a934-408d-4576-9aed-8c10fa05a50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4b8964aa-712d-4331-9e0b-aee0245e18e1 tempest-CreateVolumesFromSnapshotTest-958873287 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1975e859-1929-46e3-ad87-9fe257242b44 1073741824" returned: 0 in 0.416s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4b8964aa-712d-4331-9e0b-aee0245e18e1 tempest-CreateVolumesFromSnapshotTest-958873287 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1975e859-1929-46e3-ad87-9fe257242b44 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:17 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-d2120dd0-839b-4f59-a65f-50b1ab84bf90 tempest-CreateVolumesFromSnapshotTest-958873287 None] Volume volume-7d7248e2-24d9-44fe-b74d-8ebc922c6a66 (7d7248e2-24d9-44fe-b74d-8ebc922c6a66): created successfully
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d2120dd0-839b-4f59-a65f-50b1ab84bf90 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eca2a934-408d-4576-9aed-8c10fa05a50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d2120dd0-839b-4f59-a65f-50b1ab84bf90 tempest-CreateVolumesFromSnapshotTest-958873287 None] Flow 'volume_create_manager' (22c95900-d181-4b1c-ac89-5e8ce4fdcef3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4b8964aa-712d-4331-9e0b-aee0245e18e1 tempest-CreateVolumesFromSnapshotTest-958873287 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1975e859-1929-46e3-ad87-9fe257242b44" returned: 0 in 0.280s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-4b8964aa-712d-4331-9e0b-aee0245e18e1 tempest-CreateVolumesFromSnapshotTest-958873287 None] <== create_volume: return (714ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4b8964aa-712d-4331-9e0b-aee0245e18e1 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-74cc4959-3f3d-4c1b-879e-2725ba9c4333 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.881s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-74cc4959-3f3d-4c1b-879e-2725ba9c4333 tempest-CreateVolumesFromSnapshotTest-958873287 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1486069668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f21a259b-43f1-4f36-9e86-5dc0fb86a855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8dd1b7fc4184f4298bdeb49ed85f5e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:12:16Z,use_quota=True,user_id='de03bab7e17b4ac99ffc1e5be1652cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-74cc4959-3f3d-4c1b-879e-2725ba9c4333 tempest-CreateVolumesFromSnapshotTest-958873287 None] Creating volume f21a259b-43f1-4f36-9e86-5dc0fb86a855 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-74cc4959-3f3d-4c1b-879e-2725ba9c4333 tempest-CreateVolumesFromSnapshotTest-958873287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-74cc4959-3f3d-4c1b-879e-2725ba9c4333 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-74cc4959-3f3d-4c1b-879e-2725ba9c4333 tempest-CreateVolumesFromSnapshotTest-958873287 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-74cc4959-3f3d-4c1b-879e-2725ba9c4333 tempest-CreateVolumesFromSnapshotTest-958873287 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-74cc4959-3f3d-4c1b-879e-2725ba9c4333 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-74cc4959-3f3d-4c1b-879e-2725ba9c4333 tempest-CreateVolumesFromSnapshotTest-958873287 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 12:12:17 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-74cc4959-3f3d-4c1b-879e-2725ba9c4333 tempest-CreateVolumesFromSnapshotTest-958873287 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 12:12:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-74cc4959-3f3d-4c1b-879e-2725ba9c4333 tempest-CreateVolumesFromSnapshotTest-958873287 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f21a259b-43f1-4f36-9e86-5dc0fb86a855 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:18 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=144, name=volume-f21a259b-43f1-4f36-9e86-5dc0fb86a855, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:12:18 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-d2120dd0-839b-4f59-a65f-50b1ab84bf90 tempest-CreateVolumesFromSnapshotTest-958873287 None] Created volume successfully.
Sep 18 12:12:18 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4b8964aa-712d-4331-9e0b-aee0245e18e1 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5d41cee-1422-45da-824b-68e635c5a1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1975e859-1929-46e3-ad87-9fe257242b44', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:18 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4b8964aa-712d-4331-9e0b-aee0245e18e1 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0994d7b8-9de8-41cf-a607-e4bd3ea86021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-74cc4959-3f3d-4c1b-879e-2725ba9c4333 tempest-CreateVolumesFromSnapshotTest-958873287 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f21a259b-43f1-4f36-9e86-5dc0fb86a855 1073741824" returned: 0 in 0.472s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-74cc4959-3f3d-4c1b-879e-2725ba9c4333 tempest-CreateVolumesFromSnapshotTest-958873287 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f21a259b-43f1-4f36-9e86-5dc0fb86a855 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:18 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-4b8964aa-712d-4331-9e0b-aee0245e18e1 tempest-CreateVolumesFromSnapshotTest-958873287 None] Volume volume-1975e859-1929-46e3-ad87-9fe257242b44 (1975e859-1929-46e3-ad87-9fe257242b44): created successfully
Sep 18 12:12:18 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4b8964aa-712d-4331-9e0b-aee0245e18e1 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0994d7b8-9de8-41cf-a607-e4bd3ea86021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:18 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-4b8964aa-712d-4331-9e0b-aee0245e18e1 tempest-CreateVolumesFromSnapshotTest-958873287 None] Flow 'volume_create_manager' (0fdd19eb-4417-4d81-be3c-6514d7906fc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:12:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-74cc4959-3f3d-4c1b-879e-2725ba9c4333 tempest-CreateVolumesFromSnapshotTest-958873287 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f21a259b-43f1-4f36-9e86-5dc0fb86a855" returned: 0 in 0.308s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:18 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-74cc4959-3f3d-4c1b-879e-2725ba9c4333 tempest-CreateVolumesFromSnapshotTest-958873287 None] <== create_volume: return (802ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 12:12:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-74cc4959-3f3d-4c1b-879e-2725ba9c4333 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:12:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-fdb2d509-6bbb-4e54-b497-6381247d29a7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.235s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:12:18 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-fdb2d509-6bbb-4e54-b497-6381247d29a7 tempest-CreateVolumesFromSnapshotTest-958873287 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-40398266',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5d7f000-e027-413c-a383-9cbb769d1c28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8dd1b7fc4184f4298bdeb49ed85f5e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:12:16Z,use_quota=True,user_id='de03bab7e17b4ac99ffc1e5be1652cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 12:12:18 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-fdb2d509-6bbb-4e54-b497-6381247d29a7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Creating volume e5d7f000-e027-413c-a383-9cbb769d1c28 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 12:12:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-fdb2d509-6bbb-4e54-b497-6381247d29a7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:12:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-fdb2d509-6bbb-4e54-b497-6381247d29a7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:12:18 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-fdb2d509-6bbb-4e54-b497-6381247d29a7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:12:18 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-fdb2d509-6bbb-4e54-b497-6381247d29a7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:12:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-fdb2d509-6bbb-4e54-b497-6381247d29a7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:12:18 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-fdb2d509-6bbb-4e54-b497-6381247d29a7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 12:12:18 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-fdb2d509-6bbb-4e54-b497-6381247d29a7 tempest-CreateVolumesFromSnapshotTest-958873287 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 12:12:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fdb2d509-6bbb-4e54-b497-6381247d29a7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5d7f000-e027-413c-a383-9cbb769d1c28 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:18 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-4b8964aa-712d-4331-9e0b-aee0245e18e1 tempest-CreateVolumesFromSnapshotTest-958873287 None] Created volume successfully.
Sep 18 12:12:18 devstack quobyte-client[83193]: System call of process 100623 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 12:12:18 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=145, name=volume-e5d7f000-e027-413c-a383-9cbb769d1c28, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:12:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-74cc4959-3f3d-4c1b-879e-2725ba9c4333 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20fbbe35-3a8a-4f47-8aa7-e747d39593b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f21a259b-43f1-4f36-9e86-5dc0fb86a855', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-74cc4959-3f3d-4c1b-879e-2725ba9c4333 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b0072fd-f4a5-4bda-97f6-313d99c47b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:19 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-74cc4959-3f3d-4c1b-879e-2725ba9c4333 tempest-CreateVolumesFromSnapshotTest-958873287 None] Volume volume-f21a259b-43f1-4f36-9e86-5dc0fb86a855 (f21a259b-43f1-4f36-9e86-5dc0fb86a855): created successfully
Sep 18 12:12:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-74cc4959-3f3d-4c1b-879e-2725ba9c4333 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b0072fd-f4a5-4bda-97f6-313d99c47b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-74cc4959-3f3d-4c1b-879e-2725ba9c4333 tempest-CreateVolumesFromSnapshotTest-958873287 None] Flow 'volume_create_manager' (a49f7ec9-50ea-418a-83ee-6a3e656ae9f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:12:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fdb2d509-6bbb-4e54-b497-6381247d29a7 tempest-CreateVolumesFromSnapshotTest-958873287 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5d7f000-e027-413c-a383-9cbb769d1c28 1073741824" returned: 0 in 0.411s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fdb2d509-6bbb-4e54-b497-6381247d29a7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5d7f000-e027-413c-a383-9cbb769d1c28 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fdb2d509-6bbb-4e54-b497-6381247d29a7 tempest-CreateVolumesFromSnapshotTest-958873287 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5d7f000-e027-413c-a383-9cbb769d1c28" returned: 0 in 0.126s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:19 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-fdb2d509-6bbb-4e54-b497-6381247d29a7 tempest-CreateVolumesFromSnapshotTest-958873287 None] <== create_volume: return (579ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 12:12:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-fdb2d509-6bbb-4e54-b497-6381247d29a7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.599s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:12:19 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-74cc4959-3f3d-4c1b-879e-2725ba9c4333 tempest-CreateVolumesFromSnapshotTest-958873287 None] Created volume successfully.
Sep 18 12:12:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-fdb2d509-6bbb-4e54-b497-6381247d29a7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4008a7e6-565b-4bf8-8531-cd4caab77f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5d7f000-e027-413c-a383-9cbb769d1c28', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-fdb2d509-6bbb-4e54-b497-6381247d29a7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c74aeae-4d9c-4dc4-b7c0-a7966074c2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:19 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-fdb2d509-6bbb-4e54-b497-6381247d29a7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Volume volume-e5d7f000-e027-413c-a383-9cbb769d1c28 (e5d7f000-e027-413c-a383-9cbb769d1c28): created successfully
Sep 18 12:12:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-fdb2d509-6bbb-4e54-b497-6381247d29a7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c74aeae-4d9c-4dc4-b7c0-a7966074c2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-fdb2d509-6bbb-4e54-b497-6381247d29a7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Flow 'volume_create_manager' (1f899302-6dfa-4b02-834c-57b7444208be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:12:19 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-fdb2d509-6bbb-4e54-b497-6381247d29a7 tempest-CreateVolumesFromSnapshotTest-958873287 None] Created volume successfully.
Sep 18 12:12:19 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4e954344-52ae-4311-a10d-d763f259e958 tempest-CreateVolumesFromSnapshotTest-958873287 None] Acquiring lock "cinder-e5d7f000-e027-413c-a383-9cbb769d1c28-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:12:19 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4e954344-52ae-4311-a10d-d763f259e958 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "cinder-e5d7f000-e027-413c-a383-9cbb769d1c28-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:12:20 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-4e954344-52ae-4311-a10d-d763f259e958 tempest-CreateVolumesFromSnapshotTest-958873287 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:12:20 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4e954344-52ae-4311-a10d-d763f259e958 tempest-CreateVolumesFromSnapshotTest-958873287 None] Acquiring lock "cinder-quobyte-e5d7f000-e027-413c-a383-9cbb769d1c28" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:12:20 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4e954344-52ae-4311-a10d-d763f259e958 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "cinder-quobyte-e5d7f000-e027-413c-a383-9cbb769d1c28" acquired by "delete_volume" :: waited 0.016s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:12:20 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ce37f3-4efe-4dec-9c35-3329b31c78ca]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:12:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4e954344-52ae-4311-a10d-d763f259e958 tempest-CreateVolumesFromSnapshotTest-958873287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5d7f000-e027-413c-a383-9cbb769d1c28 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4e954344-52ae-4311-a10d-d763f259e958 tempest-CreateVolumesFromSnapshotTest-958873287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5d7f000-e027-413c-a383-9cbb769d1c28" returned: 0 in 0.387s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4e954344-52ae-4311-a10d-d763f259e958 tempest-CreateVolumesFromSnapshotTest-958873287 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5d7f000-e027-413c-a383-9cbb769d1c28 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4e954344-52ae-4311-a10d-d763f259e958 tempest-CreateVolumesFromSnapshotTest-958873287 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e5d7f000-e027-413c-a383-9cbb769d1c28" returned: 0 in 0.106s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:20 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4e954344-52ae-4311-a10d-d763f259e958 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "cinder-quobyte-e5d7f000-e027-413c-a383-9cbb769d1c28" released by "delete_volume" :: held 0.638s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:12:20 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-4e954344-52ae-4311-a10d-d763f259e958 tempest-CreateVolumesFromSnapshotTest-958873287 None] Created reservations ['1242f80d-8dba-49f9-ba7d-dd959de0bd36', '7899e07c-9bd9-42a9-9462-746b8fd31d95', 'd45783e0-f4a6-40dd-985c-464e610e1919', '3763b24c-4aca-4abf-8014-d725847291f1'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:12:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4e954344-52ae-4311-a10d-d763f259e958 tempest-CreateVolumesFromSnapshotTest-958873287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:12:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4e954344-52ae-4311-a10d-d763f259e958 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:12:21 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-4e954344-52ae-4311-a10d-d763f259e958 tempest-CreateVolumesFromSnapshotTest-958873287 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:12:21 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-4e954344-52ae-4311-a10d-d763f259e958 tempest-CreateVolumesFromSnapshotTest-958873287 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:12:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-4e954344-52ae-4311-a10d-d763f259e958 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:12:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4e954344-52ae-4311-a10d-d763f259e958 tempest-CreateVolumesFromSnapshotTest-958873287 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-4e954344-52ae-4311-a10d-d763f259e958 tempest-CreateVolumesFromSnapshotTest-958873287 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.102s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:21 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-4e954344-52ae-4311-a10d-d763f259e958 tempest-CreateVolumesFromSnapshotTest-958873287 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:12:21 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-4e954344-52ae-4311-a10d-d763f259e958 tempest-CreateVolumesFromSnapshotTest-958873287 None] Deleted volume successfully.
Sep 18 12:12:21 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-4e954344-52ae-4311-a10d-d763f259e958 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "cinder-e5d7f000-e027-413c-a383-9cbb769d1c28-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:12:22 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-2ddb91e8-d4a6-4f25-a1f8-6e735ce05d12 tempest-CreateVolumesFromSnapshotTest-958873287 None] Acquiring lock "cinder-f21a259b-43f1-4f36-9e86-5dc0fb86a855-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:12:22 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-2ddb91e8-d4a6-4f25-a1f8-6e735ce05d12 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "cinder-f21a259b-43f1-4f36-9e86-5dc0fb86a855-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:12:22 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-2ddb91e8-d4a6-4f25-a1f8-6e735ce05d12 tempest-CreateVolumesFromSnapshotTest-958873287 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:12:22 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-2ddb91e8-d4a6-4f25-a1f8-6e735ce05d12 tempest-CreateVolumesFromSnapshotTest-958873287 None] Acquiring lock "cinder-quobyte-f21a259b-43f1-4f36-9e86-5dc0fb86a855" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:12:22 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-2ddb91e8-d4a6-4f25-a1f8-6e735ce05d12 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "cinder-quobyte-f21a259b-43f1-4f36-9e86-5dc0fb86a855" acquired by "delete_volume" :: waited 0.014s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:12:22 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b89b9e-f1b4-42c9-a858-916a28b8f0b4]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:12:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2ddb91e8-d4a6-4f25-a1f8-6e735ce05d12 tempest-CreateVolumesFromSnapshotTest-958873287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f21a259b-43f1-4f36-9e86-5dc0fb86a855 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2ddb91e8-d4a6-4f25-a1f8-6e735ce05d12 tempest-CreateVolumesFromSnapshotTest-958873287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f21a259b-43f1-4f36-9e86-5dc0fb86a855" returned: 0 in 0.404s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2ddb91e8-d4a6-4f25-a1f8-6e735ce05d12 tempest-CreateVolumesFromSnapshotTest-958873287 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f21a259b-43f1-4f36-9e86-5dc0fb86a855 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2ddb91e8-d4a6-4f25-a1f8-6e735ce05d12 tempest-CreateVolumesFromSnapshotTest-958873287 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f21a259b-43f1-4f36-9e86-5dc0fb86a855" returned: 0 in 0.081s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:22 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-2ddb91e8-d4a6-4f25-a1f8-6e735ce05d12 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "cinder-quobyte-f21a259b-43f1-4f36-9e86-5dc0fb86a855" released by "delete_volume" :: held 0.638s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:12:23 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-2ddb91e8-d4a6-4f25-a1f8-6e735ce05d12 tempest-CreateVolumesFromSnapshotTest-958873287 None] Created reservations ['7f76dd43-831f-4764-9ce4-9f4708962316', 'c15fa7cd-b5f7-48a2-a7c9-5d482e918dc5', '17a65d5c-a677-4dac-8e8e-6a835cf80017', '3713d7f3-4d85-4582-a399-634995a706a5'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:12:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-2ddb91e8-d4a6-4f25-a1f8-6e735ce05d12 tempest-CreateVolumesFromSnapshotTest-958873287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:12:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-2ddb91e8-d4a6-4f25-a1f8-6e735ce05d12 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:12:23 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-2ddb91e8-d4a6-4f25-a1f8-6e735ce05d12 tempest-CreateVolumesFromSnapshotTest-958873287 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:12:23 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-2ddb91e8-d4a6-4f25-a1f8-6e735ce05d12 tempest-CreateVolumesFromSnapshotTest-958873287 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:12:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-2ddb91e8-d4a6-4f25-a1f8-6e735ce05d12 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:12:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2ddb91e8-d4a6-4f25-a1f8-6e735ce05d12 tempest-CreateVolumesFromSnapshotTest-958873287 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-2ddb91e8-d4a6-4f25-a1f8-6e735ce05d12 tempest-CreateVolumesFromSnapshotTest-958873287 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.088s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:23 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-2ddb91e8-d4a6-4f25-a1f8-6e735ce05d12 tempest-CreateVolumesFromSnapshotTest-958873287 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:12:23 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-2ddb91e8-d4a6-4f25-a1f8-6e735ce05d12 tempest-CreateVolumesFromSnapshotTest-958873287 None] Deleted volume successfully.
Sep 18 12:12:23 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-2ddb91e8-d4a6-4f25-a1f8-6e735ce05d12 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "cinder-f21a259b-43f1-4f36-9e86-5dc0fb86a855-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:12:24 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-1e662cb0-42b7-422e-b13f-7cbf4dce3e0d tempest-CreateVolumesFromSnapshotTest-958873287 None] Acquiring lock "cinder-1975e859-1929-46e3-ad87-9fe257242b44-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:12:24 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-1e662cb0-42b7-422e-b13f-7cbf4dce3e0d tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "cinder-1975e859-1929-46e3-ad87-9fe257242b44-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:12:24 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-1e662cb0-42b7-422e-b13f-7cbf4dce3e0d tempest-CreateVolumesFromSnapshotTest-958873287 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:12:24 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-1e662cb0-42b7-422e-b13f-7cbf4dce3e0d tempest-CreateVolumesFromSnapshotTest-958873287 None] Acquiring lock "cinder-quobyte-1975e859-1929-46e3-ad87-9fe257242b44" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:12:24 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-1e662cb0-42b7-422e-b13f-7cbf4dce3e0d tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "cinder-quobyte-1975e859-1929-46e3-ad87-9fe257242b44" acquired by "delete_volume" :: waited 0.017s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:12:24 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[480a3e80-6090-43cf-8224-fc7b684f29db]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:12:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1e662cb0-42b7-422e-b13f-7cbf4dce3e0d tempest-CreateVolumesFromSnapshotTest-958873287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1975e859-1929-46e3-ad87-9fe257242b44 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1e662cb0-42b7-422e-b13f-7cbf4dce3e0d tempest-CreateVolumesFromSnapshotTest-958873287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1975e859-1929-46e3-ad87-9fe257242b44" returned: 0 in 0.397s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1e662cb0-42b7-422e-b13f-7cbf4dce3e0d tempest-CreateVolumesFromSnapshotTest-958873287 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1975e859-1929-46e3-ad87-9fe257242b44 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1e662cb0-42b7-422e-b13f-7cbf4dce3e0d tempest-CreateVolumesFromSnapshotTest-958873287 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-1975e859-1929-46e3-ad87-9fe257242b44" returned: 0 in 0.090s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:25 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-1e662cb0-42b7-422e-b13f-7cbf4dce3e0d tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "cinder-quobyte-1975e859-1929-46e3-ad87-9fe257242b44" released by "delete_volume" :: held 0.636s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:12:25 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-1e662cb0-42b7-422e-b13f-7cbf4dce3e0d tempest-CreateVolumesFromSnapshotTest-958873287 None] Created reservations ['fe6293a9-580e-430f-937a-54f895dc1153', 'ea90d4df-2a75-4d47-9b79-0630aece8539', '9af1ed69-123c-43c6-a051-6a7e7de610ed', '9d1c23b2-521d-43a0-91e4-72f4b17f6432'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:12:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1e662cb0-42b7-422e-b13f-7cbf4dce3e0d tempest-CreateVolumesFromSnapshotTest-958873287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:12:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1e662cb0-42b7-422e-b13f-7cbf4dce3e0d tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:12:25 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-1e662cb0-42b7-422e-b13f-7cbf4dce3e0d tempest-CreateVolumesFromSnapshotTest-958873287 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:12:25 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-1e662cb0-42b7-422e-b13f-7cbf4dce3e0d tempest-CreateVolumesFromSnapshotTest-958873287 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:12:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-1e662cb0-42b7-422e-b13f-7cbf4dce3e0d tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:12:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1e662cb0-42b7-422e-b13f-7cbf4dce3e0d tempest-CreateVolumesFromSnapshotTest-958873287 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-1e662cb0-42b7-422e-b13f-7cbf4dce3e0d tempest-CreateVolumesFromSnapshotTest-958873287 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.082s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:25 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-1e662cb0-42b7-422e-b13f-7cbf4dce3e0d tempest-CreateVolumesFromSnapshotTest-958873287 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:12:25 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-1e662cb0-42b7-422e-b13f-7cbf4dce3e0d tempest-CreateVolumesFromSnapshotTest-958873287 None] Deleted volume successfully.
Sep 18 12:12:25 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-1e662cb0-42b7-422e-b13f-7cbf4dce3e0d tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "cinder-1975e859-1929-46e3-ad87-9fe257242b44-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:12:26 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-99e445f7-631f-4514-b341-ae67e36e8bf4 tempest-CreateVolumesFromSnapshotTest-958873287 None] Acquiring lock "cinder-7d7248e2-24d9-44fe-b74d-8ebc922c6a66-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:12:26 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-99e445f7-631f-4514-b341-ae67e36e8bf4 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "cinder-7d7248e2-24d9-44fe-b74d-8ebc922c6a66-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:12:26 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-99e445f7-631f-4514-b341-ae67e36e8bf4 tempest-CreateVolumesFromSnapshotTest-958873287 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:12:26 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-99e445f7-631f-4514-b341-ae67e36e8bf4 tempest-CreateVolumesFromSnapshotTest-958873287 None] Acquiring lock "cinder-quobyte-7d7248e2-24d9-44fe-b74d-8ebc922c6a66" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:12:26 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-99e445f7-631f-4514-b341-ae67e36e8bf4 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "cinder-quobyte-7d7248e2-24d9-44fe-b74d-8ebc922c6a66" acquired by "delete_volume" :: waited 0.014s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:12:26 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a176885-ead5-4b67-b4eb-184d8cf9bb07]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:12:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-99e445f7-631f-4514-b341-ae67e36e8bf4 tempest-CreateVolumesFromSnapshotTest-958873287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-7d7248e2-24d9-44fe-b74d-8ebc922c6a66 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-99e445f7-631f-4514-b341-ae67e36e8bf4 tempest-CreateVolumesFromSnapshotTest-958873287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-7d7248e2-24d9-44fe-b74d-8ebc922c6a66" returned: 0 in 0.372s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-99e445f7-631f-4514-b341-ae67e36e8bf4 tempest-CreateVolumesFromSnapshotTest-958873287 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-7d7248e2-24d9-44fe-b74d-8ebc922c6a66 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-99e445f7-631f-4514-b341-ae67e36e8bf4 tempest-CreateVolumesFromSnapshotTest-958873287 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-7d7248e2-24d9-44fe-b74d-8ebc922c6a66" returned: 0 in 0.081s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:27 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-99e445f7-631f-4514-b341-ae67e36e8bf4 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "cinder-quobyte-7d7248e2-24d9-44fe-b74d-8ebc922c6a66" released by "delete_volume" :: held 0.628s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:12:27 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-99e445f7-631f-4514-b341-ae67e36e8bf4 tempest-CreateVolumesFromSnapshotTest-958873287 None] Created reservations ['684c5618-3d89-47e1-9883-9e76f6c12462', 'b017ce79-46b3-47c3-9fca-5a90b8edef21', 'f9d004aa-b477-4dc9-86a7-89a9f6794649', 'c76e9e52-e72a-4e94-93f2-d1c354cce7e2'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:12:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-99e445f7-631f-4514-b341-ae67e36e8bf4 tempest-CreateVolumesFromSnapshotTest-958873287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:12:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-99e445f7-631f-4514-b341-ae67e36e8bf4 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:12:27 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-99e445f7-631f-4514-b341-ae67e36e8bf4 tempest-CreateVolumesFromSnapshotTest-958873287 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:12:27 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-99e445f7-631f-4514-b341-ae67e36e8bf4 tempest-CreateVolumesFromSnapshotTest-958873287 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:12:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-99e445f7-631f-4514-b341-ae67e36e8bf4 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:12:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-99e445f7-631f-4514-b341-ae67e36e8bf4 tempest-CreateVolumesFromSnapshotTest-958873287 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:28 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-bb470876-267e-4ffe-b587-58a17735dac9 tempest-CreateVolumesFromSnapshotTest-958873287 None] Acquiring lock "cinder-ccff635a-9dd1-4462-a82a-0d0878f5dd8c-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:12:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-99e445f7-631f-4514-b341-ae67e36e8bf4 tempest-CreateVolumesFromSnapshotTest-958873287 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.307s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:28 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-99e445f7-631f-4514-b341-ae67e36e8bf4 tempest-CreateVolumesFromSnapshotTest-958873287 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:12:28 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-99e445f7-631f-4514-b341-ae67e36e8bf4 tempest-CreateVolumesFromSnapshotTest-958873287 None] Deleted volume successfully.
Sep 18 12:12:28 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-bb470876-267e-4ffe-b587-58a17735dac9 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "cinder-ccff635a-9dd1-4462-a82a-0d0878f5dd8c-delete_volume" acquired by "delete_volume" :: waited 0.248s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:12:28 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-99e445f7-631f-4514-b341-ae67e36e8bf4 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "cinder-7d7248e2-24d9-44fe-b74d-8ebc922c6a66-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:12:28 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-bb470876-267e-4ffe-b587-58a17735dac9 tempest-CreateVolumesFromSnapshotTest-958873287 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:12:28 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-bb470876-267e-4ffe-b587-58a17735dac9 tempest-CreateVolumesFromSnapshotTest-958873287 None] Acquiring lock "cinder-quobyte-ccff635a-9dd1-4462-a82a-0d0878f5dd8c" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:12:28 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-bb470876-267e-4ffe-b587-58a17735dac9 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "cinder-quobyte-ccff635a-9dd1-4462-a82a-0d0878f5dd8c" acquired by "delete_volume" :: waited 0.014s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:12:28 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4215a4-0979-4286-9db3-362b7996c286]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:12:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-bb470876-267e-4ffe-b587-58a17735dac9 tempest-CreateVolumesFromSnapshotTest-958873287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-ccff635a-9dd1-4462-a82a-0d0878f5dd8c {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-bb470876-267e-4ffe-b587-58a17735dac9 tempest-CreateVolumesFromSnapshotTest-958873287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-ccff635a-9dd1-4462-a82a-0d0878f5dd8c" returned: 0 in 0.436s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-bb470876-267e-4ffe-b587-58a17735dac9 tempest-CreateVolumesFromSnapshotTest-958873287 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-ccff635a-9dd1-4462-a82a-0d0878f5dd8c {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-bb470876-267e-4ffe-b587-58a17735dac9 tempest-CreateVolumesFromSnapshotTest-958873287 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-ccff635a-9dd1-4462-a82a-0d0878f5dd8c" returned: 0 in 0.159s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:29 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-bb470876-267e-4ffe-b587-58a17735dac9 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "cinder-quobyte-ccff635a-9dd1-4462-a82a-0d0878f5dd8c" released by "delete_volume" :: held 0.678s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:12:29 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-bb470876-267e-4ffe-b587-58a17735dac9 tempest-CreateVolumesFromSnapshotTest-958873287 None] Created reservations ['93b53fa8-02f7-4608-a232-e7da6627d80a', 'cf44265f-382d-46b2-b30f-892cd18c15ec', '49b9a334-39c9-4f0d-81fe-64aba4bbd274', '191d21e3-53a5-4a47-9daa-0cfae14717d5'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:12:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-bb470876-267e-4ffe-b587-58a17735dac9 tempest-CreateVolumesFromSnapshotTest-958873287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:12:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-bb470876-267e-4ffe-b587-58a17735dac9 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:12:29 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-bb470876-267e-4ffe-b587-58a17735dac9 tempest-CreateVolumesFromSnapshotTest-958873287 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:12:29 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-bb470876-267e-4ffe-b587-58a17735dac9 tempest-CreateVolumesFromSnapshotTest-958873287 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:12:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-bb470876-267e-4ffe-b587-58a17735dac9 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:12:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-bb470876-267e-4ffe-b587-58a17735dac9 tempest-CreateVolumesFromSnapshotTest-958873287 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-bb470876-267e-4ffe-b587-58a17735dac9 tempest-CreateVolumesFromSnapshotTest-958873287 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.085s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:29 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-bb470876-267e-4ffe-b587-58a17735dac9 tempest-CreateVolumesFromSnapshotTest-958873287 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:12:29 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-bb470876-267e-4ffe-b587-58a17735dac9 tempest-CreateVolumesFromSnapshotTest-958873287 None] Deleted volume successfully.
Sep 18 12:12:30 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-bb470876-267e-4ffe-b587-58a17735dac9 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "cinder-ccff635a-9dd1-4462-a82a-0d0878f5dd8c-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:12:30 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-92e38f03-b00a-4e07-a9e3-02494e53eb0a tempest-CreateVolumesFromSnapshotTest-958873287 None] Acquiring lock "cinder-723b6e38-cfed-4be9-9d1a-8d8b6623f2a4-delete_snapshot" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:12:30 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-92e38f03-b00a-4e07-a9e3-02494e53eb0a tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "cinder-723b6e38-cfed-4be9-9d1a-8d8b6623f2a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:12:30 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-92e38f03-b00a-4e07-a9e3-02494e53eb0a tempest-CreateVolumesFromSnapshotTest-958873287 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:12:30 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-92e38f03-b00a-4e07-a9e3-02494e53eb0a tempest-CreateVolumesFromSnapshotTest-958873287 None] Acquiring lock "cinder-quobyte-f3b12a2a-6f34-4387-953a-a2d0cb1ea477" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:12:30 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-92e38f03-b00a-4e07-a9e3-02494e53eb0a tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "cinder-quobyte-f3b12a2a-6f34-4387-953a-a2d0cb1ea477" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:12:30 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-92e38f03-b00a-4e07-a9e3-02494e53eb0a tempest-CreateVolumesFromSnapshotTest-958873287 None] Acquiring lock "cinder-quobyte-723b6e38-cfed-4be9-9d1a-8d8b6623f2a4" by "_delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:12:30 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-92e38f03-b00a-4e07-a9e3-02494e53eb0a tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "cinder-quobyte-723b6e38-cfed-4be9-9d1a-8d8b6623f2a4" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:12:30 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-92e38f03-b00a-4e07-a9e3-02494e53eb0a tempest-CreateVolumesFromSnapshotTest-958873287 None] Deleting offline snapshot 723b6e38-cfed-4be9-9d1a-8d8b6623f2a4 of volume f3b12a2a-6f34-4387-953a-a2d0cb1ea477 {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 12:12:30 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-92e38f03-b00a-4e07-a9e3-02494e53eb0a tempest-CreateVolumesFromSnapshotTest-958873287 None] snapshot_file for this snap is: volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477.723b6e38-cfed-4be9-9d1a-8d8b6623f2a4 {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 12:12:30 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d527953f-5556-458b-b26b-5df18c6461fe]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:12:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-92e38f03-b00a-4e07-a9e3-02494e53eb0a tempest-CreateVolumesFromSnapshotTest-958873287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477.723b6e38-cfed-4be9-9d1a-8d8b6623f2a4 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-92e38f03-b00a-4e07-a9e3-02494e53eb0a tempest-CreateVolumesFromSnapshotTest-958873287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477.723b6e38-cfed-4be9-9d1a-8d8b6623f2a4" returned: 0 in 0.385s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:30 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-92e38f03-b00a-4e07-a9e3-02494e53eb0a tempest-CreateVolumesFromSnapshotTest-958873287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 12:12:30 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a44017-fdce-4a59-a6ae-acaa7d5636d4]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:12:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-92e38f03-b00a-4e07-a9e3-02494e53eb0a tempest-CreateVolumesFromSnapshotTest-958873287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-92e38f03-b00a-4e07-a9e3-02494e53eb0a tempest-CreateVolumesFromSnapshotTest-958873287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477" returned: 0 in 0.390s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-92e38f03-b00a-4e07-a9e3-02494e53eb0a tempest-CreateVolumesFromSnapshotTest-958873287 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477.723b6e38-cfed-4be9-9d1a-8d8b6623f2a4 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-92e38f03-b00a-4e07-a9e3-02494e53eb0a tempest-CreateVolumesFromSnapshotTest-958873287 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477.723b6e38-cfed-4be9-9d1a-8d8b6623f2a4" returned: 0 in 0.241s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-92e38f03-b00a-4e07-a9e3-02494e53eb0a tempest-CreateVolumesFromSnapshotTest-958873287 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477.723b6e38-cfed-4be9-9d1a-8d8b6623f2a4 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-92e38f03-b00a-4e07-a9e3-02494e53eb0a tempest-CreateVolumesFromSnapshotTest-958873287 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477.723b6e38-cfed-4be9-9d1a-8d8b6623f2a4" returned: 0 in 0.092s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:31 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-92e38f03-b00a-4e07-a9e3-02494e53eb0a tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "cinder-quobyte-723b6e38-cfed-4be9-9d1a-8d8b6623f2a4" released by "_delete_snapshot" :: held 1.389s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:12:31 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-92e38f03-b00a-4e07-a9e3-02494e53eb0a tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "cinder-quobyte-f3b12a2a-6f34-4387-953a-a2d0cb1ea477" released by "delete_snapshot" :: held 1.413s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:12:32 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-92e38f03-b00a-4e07-a9e3-02494e53eb0a tempest-CreateVolumesFromSnapshotTest-958873287 None] Created reservations ['c6f4482f-e4dd-43ae-9cb9-8ff957bf3e2d', 'c020ecab-24ae-4b7e-a3fc-51ddc78e2a6c', 'bc6b6bef-9b5e-4d91-8c10-3e223fa7079f', '92bed074-689d-47f4-abb0-362620da34a6'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:12:32 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-92e38f03-b00a-4e07-a9e3-02494e53eb0a tempest-CreateVolumesFromSnapshotTest-958873287 None] Delete snapshot completed successfully.
Sep 18 12:12:32 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-92e38f03-b00a-4e07-a9e3-02494e53eb0a tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "cinder-723b6e38-cfed-4be9-9d1a-8d8b6623f2a4-delete_snapshot" released by "delete_snapshot" :: held 1.820s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:12:32 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-7554ac3b-d6ed-49ed-aa39-11553a344f78 tempest-CreateVolumesFromSnapshotTest-958873287 None] Acquiring lock "cinder-f3b12a2a-6f34-4387-953a-a2d0cb1ea477-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:12:32 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-7554ac3b-d6ed-49ed-aa39-11553a344f78 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "cinder-f3b12a2a-6f34-4387-953a-a2d0cb1ea477-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:12:32 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-7554ac3b-d6ed-49ed-aa39-11553a344f78 tempest-CreateVolumesFromSnapshotTest-958873287 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:12:32 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-7554ac3b-d6ed-49ed-aa39-11553a344f78 tempest-CreateVolumesFromSnapshotTest-958873287 None] Acquiring lock "cinder-quobyte-f3b12a2a-6f34-4387-953a-a2d0cb1ea477" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:12:32 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-7554ac3b-d6ed-49ed-aa39-11553a344f78 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "cinder-quobyte-f3b12a2a-6f34-4387-953a-a2d0cb1ea477" acquired by "delete_volume" :: waited 0.009s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:12:32 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[11de43be-3520-49cb-8213-bb19ef0edd18]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:12:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7554ac3b-d6ed-49ed-aa39-11553a344f78 tempest-CreateVolumesFromSnapshotTest-958873287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7554ac3b-d6ed-49ed-aa39-11553a344f78 tempest-CreateVolumesFromSnapshotTest-958873287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477" returned: 0 in 0.394s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7554ac3b-d6ed-49ed-aa39-11553a344f78 tempest-CreateVolumesFromSnapshotTest-958873287 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7554ac3b-d6ed-49ed-aa39-11553a344f78 tempest-CreateVolumesFromSnapshotTest-958873287 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f3b12a2a-6f34-4387-953a-a2d0cb1ea477" returned: 0 in 0.106s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:33 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-7554ac3b-d6ed-49ed-aa39-11553a344f78 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "cinder-quobyte-f3b12a2a-6f34-4387-953a-a2d0cb1ea477" released by "delete_volume" :: held 0.652s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:12:33 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-7554ac3b-d6ed-49ed-aa39-11553a344f78 tempest-CreateVolumesFromSnapshotTest-958873287 None] Created reservations ['15a60602-cc76-48f4-a5c6-8fa1b93fb77c', 'f97beee6-3e7c-4f31-981b-23ffbc238af9', '89dffdae-a894-4298-9ad8-b106347d2692', '21d1eca9-1551-473e-ac39-88c1153c73a3'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:12:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-7554ac3b-d6ed-49ed-aa39-11553a344f78 tempest-CreateVolumesFromSnapshotTest-958873287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:12:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-7554ac3b-d6ed-49ed-aa39-11553a344f78 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:12:33 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-7554ac3b-d6ed-49ed-aa39-11553a344f78 tempest-CreateVolumesFromSnapshotTest-958873287 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:12:33 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-7554ac3b-d6ed-49ed-aa39-11553a344f78 tempest-CreateVolumesFromSnapshotTest-958873287 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:12:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-7554ac3b-d6ed-49ed-aa39-11553a344f78 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:12:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7554ac3b-d6ed-49ed-aa39-11553a344f78 tempest-CreateVolumesFromSnapshotTest-958873287 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-7554ac3b-d6ed-49ed-aa39-11553a344f78 tempest-CreateVolumesFromSnapshotTest-958873287 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.278s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:34 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-7554ac3b-d6ed-49ed-aa39-11553a344f78 tempest-CreateVolumesFromSnapshotTest-958873287 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:12:34 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-7554ac3b-d6ed-49ed-aa39-11553a344f78 tempest-CreateVolumesFromSnapshotTest-958873287 None] Deleted volume successfully.
Sep 18 12:12:34 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-7554ac3b-d6ed-49ed-aa39-11553a344f78 tempest-CreateVolumesFromSnapshotTest-958873287 None] Lock "cinder-f3b12a2a-6f34-4387-953a-a2d0cb1ea477-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:12:44 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=46,cinder:UPDATE=67,cinder:DELETE=4,cinder:INSERT=14 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 12:12:44 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:UPDATE=67,cinder:SELECT=39,cinder:DELETE=9,cinder:INSERT=14 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 12:12:53 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-72452114-403c-4dad-b70f-e73f71099fdc tempest-CinderUnicodeTest-696598782 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:12:53 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-72452114-403c-4dad-b70f-e73f71099fdc tempest-CinderUnicodeTest-696598782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 12:12:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-72452114-403c-4dad-b70f-e73f71099fdc tempest-CinderUnicodeTest-696598782 None] Flow 'volume_create_manager' (8744e60f-3c4c-4c81-a15c-a80c6930c873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:12:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-72452114-403c-4dad-b70f-e73f71099fdc tempest-CinderUnicodeTest-696598782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (841d2d24-3283-4680-ab90-6a767037cefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-72452114-403c-4dad-b70f-e73f71099fdc tempest-CinderUnicodeTest-696598782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (841d2d24-3283-4680-ab90-6a767037cefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2a17775-259c-4c62-8102-a341b3e42fbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f641c489693474a95beb826e1f57c5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:12:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:12:53Z,use_quota=True,user_id='04525e46a410450abfb6c0f756d6c402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-72452114-403c-4dad-b70f-e73f71099fdc tempest-CinderUnicodeTest-696598782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d18dd4e5-8a62-4035-87b1-c5a1169703ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-72452114-403c-4dad-b70f-e73f71099fdc tempest-CinderUnicodeTest-696598782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d18dd4e5-8a62-4035-87b1-c5a1169703ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-72452114-403c-4dad-b70f-e73f71099fdc tempest-CinderUnicodeTest-696598782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce6961b5-1ffb-48c0-b7b0-9718b8fa2a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-72452114-403c-4dad-b70f-e73f71099fdc tempest-CinderUnicodeTest-696598782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce6961b5-1ffb-48c0-b7b0-9718b8fa2a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2a17775-259c-4c62-8102-a341b3e42fbf', 'volume_name': 'volume-e2a17775-259c-4c62-8102-a341b3e42fbf', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-72452114-403c-4dad-b70f-e73f71099fdc tempest-CinderUnicodeTest-696598782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0119844-e089-4401-b1a3-54f95d220bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-72452114-403c-4dad-b70f-e73f71099fdc tempest-CinderUnicodeTest-696598782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0119844-e089-4401-b1a3-54f95d220bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:53 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-72452114-403c-4dad-b70f-e73f71099fdc tempest-CinderUnicodeTest-696598782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdbcb6f8-ba06-497f-a95d-39da2b6682b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:53 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-72452114-403c-4dad-b70f-e73f71099fdc tempest-CinderUnicodeTest-696598782 None] Volume e2a17775-259c-4c62-8102-a341b3e42fbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2a17775-259c-4c62-8102-a341b3e42fbf', 'volume_size': 1}
Sep 18 12:12:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-72452114-403c-4dad-b70f-e73f71099fdc tempest-CinderUnicodeTest-696598782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:12:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-72452114-403c-4dad-b70f-e73f71099fdc tempest-CinderUnicodeTest-696598782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:12:53 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-72452114-403c-4dad-b70f-e73f71099fdc tempest-CinderUnicodeTest-696598782 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2a17775-259c-4c62-8102-a341b3e42fbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f641c489693474a95beb826e1f57c5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:12:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:12:53Z,use_quota=True,user_id='04525e46a410450abfb6c0f756d6c402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 12:12:53 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-72452114-403c-4dad-b70f-e73f71099fdc tempest-CinderUnicodeTest-696598782 None] Creating volume e2a17775-259c-4c62-8102-a341b3e42fbf {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 12:12:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-72452114-403c-4dad-b70f-e73f71099fdc tempest-CinderUnicodeTest-696598782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:12:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-72452114-403c-4dad-b70f-e73f71099fdc tempest-CinderUnicodeTest-696598782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:12:53 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-72452114-403c-4dad-b70f-e73f71099fdc tempest-CinderUnicodeTest-696598782 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:12:53 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-72452114-403c-4dad-b70f-e73f71099fdc tempest-CinderUnicodeTest-696598782 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:12:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-72452114-403c-4dad-b70f-e73f71099fdc tempest-CinderUnicodeTest-696598782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:12:53 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-72452114-403c-4dad-b70f-e73f71099fdc tempest-CinderUnicodeTest-696598782 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 12:12:53 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-72452114-403c-4dad-b70f-e73f71099fdc tempest-CinderUnicodeTest-696598782 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 12:12:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-72452114-403c-4dad-b70f-e73f71099fdc tempest-CinderUnicodeTest-696598782 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e2a17775-259c-4c62-8102-a341b3e42fbf 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:54 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-12479ee0-7957-4383-990f-028582c6cf2f tempest-CreateVolumesFromImageTest-1894321723 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:12:54 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=146, name=volume-e2a17775-259c-4c62-8102-a341b3e42fbf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:12:54 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-12479ee0-7957-4383-990f-028582c6cf2f tempest-CreateVolumesFromImageTest-1894321723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 12:12:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-12479ee0-7957-4383-990f-028582c6cf2f tempest-CreateVolumesFromImageTest-1894321723 None] Flow 'volume_create_manager' (7225ea10-c505-426c-a629-6aed3b45b6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:12:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-12479ee0-7957-4383-990f-028582c6cf2f tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78d25126-835a-4669-85b7-35a60e877fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-12479ee0-7957-4383-990f-028582c6cf2f tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78d25126-835a-4669-85b7-35a60e877fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-165412205',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7be7c7d-43ef-40b9-9e14-bb5b10e937b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4e9b742f5e4faaa1750f7b3cb19da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:12:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:12:53Z,use_quota=True,user_id='04fb4f85bd7046bfb6cb8df7699f0748',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-12479ee0-7957-4383-990f-028582c6cf2f tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69e05315-aae9-49ab-9767-dfee19607142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-12479ee0-7957-4383-990f-028582c6cf2f tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69e05315-aae9-49ab-9767-dfee19607142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-12479ee0-7957-4383-990f-028582c6cf2f tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6717da6-18cb-4f3d-87fd-b79ddcf9f586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-12479ee0-7957-4383-990f-028582c6cf2f tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6717da6-18cb-4f3d-87fd-b79ddcf9f586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7be7c7d-43ef-40b9-9e14-bb5b10e937b8', 'volume_name': 'volume-b7be7c7d-43ef-40b9-9e14-bb5b10e937b8', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-12479ee0-7957-4383-990f-028582c6cf2f tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8b9071c-8513-4b26-a4c3-6c4f790aaaa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-12479ee0-7957-4383-990f-028582c6cf2f tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8b9071c-8513-4b26-a4c3-6c4f790aaaa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:54 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-12479ee0-7957-4383-990f-028582c6cf2f tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9ca3ceb-a1da-431c-8057-87a830ddca5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:54 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-12479ee0-7957-4383-990f-028582c6cf2f tempest-CreateVolumesFromImageTest-1894321723 None] Volume b7be7c7d-43ef-40b9-9e14-bb5b10e937b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7be7c7d-43ef-40b9-9e14-bb5b10e937b8', 'volume_size': 1}
Sep 18 12:12:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-12479ee0-7957-4383-990f-028582c6cf2f tempest-CreateVolumesFromImageTest-1894321723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:12:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-72452114-403c-4dad-b70f-e73f71099fdc tempest-CinderUnicodeTest-696598782 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e2a17775-259c-4c62-8102-a341b3e42fbf 1073741824" returned: 0 in 1.020s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-72452114-403c-4dad-b70f-e73f71099fdc tempest-CinderUnicodeTest-696598782 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e2a17775-259c-4c62-8102-a341b3e42fbf {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:55 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-f5ef5ca7-88e8-443e-9eb7-f59cff01458c tempest-CreateVolumesFromImageTest-1894321723 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:12:55 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5ef5ca7-88e8-443e-9eb7-f59cff01458c tempest-CreateVolumesFromImageTest-1894321723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 12:12:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f5ef5ca7-88e8-443e-9eb7-f59cff01458c tempest-CreateVolumesFromImageTest-1894321723 None] Flow 'volume_create_manager' (1373406c-3ae0-454e-bdf3-8daba213a5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:12:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f5ef5ca7-88e8-443e-9eb7-f59cff01458c tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d18b0f64-28d2-4863-8148-9aaf79e65687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f5ef5ca7-88e8-443e-9eb7-f59cff01458c tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d18b0f64-28d2-4863-8148-9aaf79e65687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:12:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-138883650',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8ea8ceb-6be5-4a78-9d7d-b96072001a1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4e9b742f5e4faaa1750f7b3cb19da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:12:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:12:54Z,use_quota=True,user_id='04fb4f85bd7046bfb6cb8df7699f0748',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f5ef5ca7-88e8-443e-9eb7-f59cff01458c tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8390f1d-496d-4f21-a187-190d0bee8aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f5ef5ca7-88e8-443e-9eb7-f59cff01458c tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8390f1d-496d-4f21-a187-190d0bee8aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f5ef5ca7-88e8-443e-9eb7-f59cff01458c tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72f656fd-16a8-49c9-a00d-a65f7ac53949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f5ef5ca7-88e8-443e-9eb7-f59cff01458c tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72f656fd-16a8-49c9-a00d-a65f7ac53949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8ea8ceb-6be5-4a78-9d7d-b96072001a1b', 'volume_name': 'volume-a8ea8ceb-6be5-4a78-9d7d-b96072001a1b', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f5ef5ca7-88e8-443e-9eb7-f59cff01458c tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13dc1bf4-e782-4c5e-a5f6-8fa2508e274a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f5ef5ca7-88e8-443e-9eb7-f59cff01458c tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13dc1bf4-e782-4c5e-a5f6-8fa2508e274a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f5ef5ca7-88e8-443e-9eb7-f59cff01458c tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea145129-d0b8-4bbd-b87a-ecd6a4904b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:55 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-f5ef5ca7-88e8-443e-9eb7-f59cff01458c tempest-CreateVolumesFromImageTest-1894321723 None] Volume a8ea8ceb-6be5-4a78-9d7d-b96072001a1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8ea8ceb-6be5-4a78-9d7d-b96072001a1b', 'volume_size': 1}
Sep 18 12:12:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f5ef5ca7-88e8-443e-9eb7-f59cff01458c tempest-CreateVolumesFromImageTest-1894321723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:12:55 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-70da7b54-c948-4f88-a5dc-5dc485f1e8cd tempest-CreateVolumesFromImageTest-1894321723 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:12:55 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-70da7b54-c948-4f88-a5dc-5dc485f1e8cd tempest-CreateVolumesFromImageTest-1894321723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 12:12:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-70da7b54-c948-4f88-a5dc-5dc485f1e8cd tempest-CreateVolumesFromImageTest-1894321723 None] Flow 'volume_create_manager' (7c54753b-dfe5-4452-b209-abb240011034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:12:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-70da7b54-c948-4f88-a5dc-5dc485f1e8cd tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (088cf0b2-e131-4063-b17d-7af064c87fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-70da7b54-c948-4f88-a5dc-5dc485f1e8cd tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (088cf0b2-e131-4063-b17d-7af064c87fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-823811913',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=361b9d35-5de4-404b-a0bb-142b7ba65a9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4e9b742f5e4faaa1750f7b3cb19da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:12:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:12:54Z,use_quota=True,user_id='04fb4f85bd7046bfb6cb8df7699f0748',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-70da7b54-c948-4f88-a5dc-5dc485f1e8cd tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae711230-a409-4683-b2f7-9f01ddd1e50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-70da7b54-c948-4f88-a5dc-5dc485f1e8cd tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae711230-a409-4683-b2f7-9f01ddd1e50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-70da7b54-c948-4f88-a5dc-5dc485f1e8cd tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1081593-ad4b-43d9-a83c-03e7b38008dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-70da7b54-c948-4f88-a5dc-5dc485f1e8cd tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1081593-ad4b-43d9-a83c-03e7b38008dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '361b9d35-5de4-404b-a0bb-142b7ba65a9e', 'volume_name': 'volume-361b9d35-5de4-404b-a0bb-142b7ba65a9e', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-70da7b54-c948-4f88-a5dc-5dc485f1e8cd tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b1772d7-9a2a-4dac-8083-3d2ff12f674f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-70da7b54-c948-4f88-a5dc-5dc485f1e8cd tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b1772d7-9a2a-4dac-8083-3d2ff12f674f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:55 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-70da7b54-c948-4f88-a5dc-5dc485f1e8cd tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c39d65a-8164-40d0-8352-7e9d24527dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:55 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-70da7b54-c948-4f88-a5dc-5dc485f1e8cd tempest-CreateVolumesFromImageTest-1894321723 None] Volume 361b9d35-5de4-404b-a0bb-142b7ba65a9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-361b9d35-5de4-404b-a0bb-142b7ba65a9e', 'volume_size': 1}
Sep 18 12:12:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-70da7b54-c948-4f88-a5dc-5dc485f1e8cd tempest-CreateVolumesFromImageTest-1894321723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:12:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-72452114-403c-4dad-b70f-e73f71099fdc tempest-CinderUnicodeTest-696598782 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e2a17775-259c-4c62-8102-a341b3e42fbf" returned: 0 in 0.874s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:55 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-72452114-403c-4dad-b70f-e73f71099fdc tempest-CinderUnicodeTest-696598782 None] <== create_volume: return (1933ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 12:12:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-72452114-403c-4dad-b70f-e73f71099fdc tempest-CinderUnicodeTest-696598782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.940s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:12:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-12479ee0-7957-4383-990f-028582c6cf2f tempest-CreateVolumesFromImageTest-1894321723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.985s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:12:55 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-12479ee0-7957-4383-990f-028582c6cf2f tempest-CreateVolumesFromImageTest-1894321723 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-165412205',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7be7c7d-43ef-40b9-9e14-bb5b10e937b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4e9b742f5e4faaa1750f7b3cb19da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:12:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:12:53Z,use_quota=True,user_id='04fb4f85bd7046bfb6cb8df7699f0748',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 12:12:55 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-12479ee0-7957-4383-990f-028582c6cf2f tempest-CreateVolumesFromImageTest-1894321723 None] Creating volume b7be7c7d-43ef-40b9-9e14-bb5b10e937b8 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 12:12:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-12479ee0-7957-4383-990f-028582c6cf2f tempest-CreateVolumesFromImageTest-1894321723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:12:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-12479ee0-7957-4383-990f-028582c6cf2f tempest-CreateVolumesFromImageTest-1894321723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:12:55 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-12479ee0-7957-4383-990f-028582c6cf2f tempest-CreateVolumesFromImageTest-1894321723 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:12:55 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-12479ee0-7957-4383-990f-028582c6cf2f tempest-CreateVolumesFromImageTest-1894321723 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:12:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-12479ee0-7957-4383-990f-028582c6cf2f tempest-CreateVolumesFromImageTest-1894321723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:12:55 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-12479ee0-7957-4383-990f-028582c6cf2f tempest-CreateVolumesFromImageTest-1894321723 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 12:12:55 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-12479ee0-7957-4383-990f-028582c6cf2f tempest-CreateVolumesFromImageTest-1894321723 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 12:12:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-12479ee0-7957-4383-990f-028582c6cf2f tempest-CreateVolumesFromImageTest-1894321723 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b7be7c7d-43ef-40b9-9e14-bb5b10e937b8 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:55 devstack quobyte-client[83193]: System call of process 100723 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 12:12:55 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=147, name=volume-b7be7c7d-43ef-40b9-9e14-bb5b10e937b8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:12:56 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-72452114-403c-4dad-b70f-e73f71099fdc tempest-CinderUnicodeTest-696598782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdbcb6f8-ba06-497f-a95d-39da2b6682b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2a17775-259c-4c62-8102-a341b3e42fbf', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:56 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-72452114-403c-4dad-b70f-e73f71099fdc tempest-CinderUnicodeTest-696598782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56a55f4a-b671-46ab-ab20-95ceba744f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:56 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-d92a3dc7-d6ff-4a67-a997-dc684c5a2c9c tempest-CreateVolumesFromImageTest-1894321723 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:12:56 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-d92a3dc7-d6ff-4a67-a997-dc684c5a2c9c tempest-CreateVolumesFromImageTest-1894321723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 12:12:56 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d92a3dc7-d6ff-4a67-a997-dc684c5a2c9c tempest-CreateVolumesFromImageTest-1894321723 None] Flow 'volume_create_manager' (7d67ed38-5129-40ad-859a-ea1bccbf7d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:12:56 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d92a3dc7-d6ff-4a67-a997-dc684c5a2c9c tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0ebce04-def1-4bbc-868d-84bdc039c9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:56 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d92a3dc7-d6ff-4a67-a997-dc684c5a2c9c tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0ebce04-def1-4bbc-868d-84bdc039c9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1302687165',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bccee59a-7f40-40e3-8f11-e668ae2c2b19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4e9b742f5e4faaa1750f7b3cb19da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:12:55Z,use_quota=True,user_id='04fb4f85bd7046bfb6cb8df7699f0748',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:56 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d92a3dc7-d6ff-4a67-a997-dc684c5a2c9c tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2dc3cc1-bd38-4dcf-9fdc-6bbd728e8cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:56 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d92a3dc7-d6ff-4a67-a997-dc684c5a2c9c tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2dc3cc1-bd38-4dcf-9fdc-6bbd728e8cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:56 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d92a3dc7-d6ff-4a67-a997-dc684c5a2c9c tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4e4806f-505e-48c3-afa1-e557032a7971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:56 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d92a3dc7-d6ff-4a67-a997-dc684c5a2c9c tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4e4806f-505e-48c3-afa1-e557032a7971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bccee59a-7f40-40e3-8f11-e668ae2c2b19', 'volume_name': 'volume-bccee59a-7f40-40e3-8f11-e668ae2c2b19', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:56 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d92a3dc7-d6ff-4a67-a997-dc684c5a2c9c tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4749ef-17fa-4956-8e9e-1171a43280dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:56 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d92a3dc7-d6ff-4a67-a997-dc684c5a2c9c tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4749ef-17fa-4956-8e9e-1171a43280dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:56 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d92a3dc7-d6ff-4a67-a997-dc684c5a2c9c tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ed41da1-9010-40c6-b254-11bb8457cd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:56 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-d92a3dc7-d6ff-4a67-a997-dc684c5a2c9c tempest-CreateVolumesFromImageTest-1894321723 None] Volume bccee59a-7f40-40e3-8f11-e668ae2c2b19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bccee59a-7f40-40e3-8f11-e668ae2c2b19', 'volume_size': 1}
Sep 18 12:12:56 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d92a3dc7-d6ff-4a67-a997-dc684c5a2c9c tempest-CreateVolumesFromImageTest-1894321723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:12:56 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-72452114-403c-4dad-b70f-e73f71099fdc tempest-CinderUnicodeTest-696598782 None] Volume volume-e2a17775-259c-4c62-8102-a341b3e42fbf (e2a17775-259c-4c62-8102-a341b3e42fbf): created successfully
Sep 18 12:12:56 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-72452114-403c-4dad-b70f-e73f71099fdc tempest-CinderUnicodeTest-696598782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56a55f4a-b671-46ab-ab20-95ceba744f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:56 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-72452114-403c-4dad-b70f-e73f71099fdc tempest-CinderUnicodeTest-696598782 None] Flow 'volume_create_manager' (8744e60f-3c4c-4c81-a15c-a80c6930c873) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:12:56 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-b1af8cbe-3043-4b44-89f9-a3711ed3c4bf tempest-CreateVolumesFromImageTest-1894321723 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:12:56 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1af8cbe-3043-4b44-89f9-a3711ed3c4bf tempest-CreateVolumesFromImageTest-1894321723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 12:12:56 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b1af8cbe-3043-4b44-89f9-a3711ed3c4bf tempest-CreateVolumesFromImageTest-1894321723 None] Flow 'volume_create_manager' (0e0949bb-4d3e-4545-8487-36691664e8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:12:56 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b1af8cbe-3043-4b44-89f9-a3711ed3c4bf tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f17802c7-bf7a-499c-bb46-62a68add0272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:56 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-12479ee0-7957-4383-990f-028582c6cf2f tempest-CreateVolumesFromImageTest-1894321723 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b7be7c7d-43ef-40b9-9e14-bb5b10e937b8 1073741824" returned: 0 in 0.685s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:56 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-72452114-403c-4dad-b70f-e73f71099fdc tempest-CinderUnicodeTest-696598782 None] Created volume successfully.
Sep 18 12:12:56 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-12479ee0-7957-4383-990f-028582c6cf2f tempest-CreateVolumesFromImageTest-1894321723 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b7be7c7d-43ef-40b9-9e14-bb5b10e937b8 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:56 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b1af8cbe-3043-4b44-89f9-a3711ed3c4bf tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f17802c7-bf7a-499c-bb46-62a68add0272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-848010112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65903d9e-5528-4ea2-94af-55293bb4586e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4e9b742f5e4faaa1750f7b3cb19da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:12:55Z,use_quota=True,user_id='04fb4f85bd7046bfb6cb8df7699f0748',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:56 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b1af8cbe-3043-4b44-89f9-a3711ed3c4bf tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (523f12c5-4488-45ff-a42a-468a4b7a4715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:56 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b1af8cbe-3043-4b44-89f9-a3711ed3c4bf tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (523f12c5-4488-45ff-a42a-468a4b7a4715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:56 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b1af8cbe-3043-4b44-89f9-a3711ed3c4bf tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7855ba9e-a5ee-47ff-99a3-caeaf5af7e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:56 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b1af8cbe-3043-4b44-89f9-a3711ed3c4bf tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7855ba9e-a5ee-47ff-99a3-caeaf5af7e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65903d9e-5528-4ea2-94af-55293bb4586e', 'volume_name': 'volume-65903d9e-5528-4ea2-94af-55293bb4586e', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:56 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b1af8cbe-3043-4b44-89f9-a3711ed3c4bf tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (378a02bd-3d7b-41fe-a0a0-5bebbfb65600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:56 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b1af8cbe-3043-4b44-89f9-a3711ed3c4bf tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (378a02bd-3d7b-41fe-a0a0-5bebbfb65600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:56 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b1af8cbe-3043-4b44-89f9-a3711ed3c4bf tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba2960b1-7b8f-4425-8071-393ae4a97df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:56 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-b1af8cbe-3043-4b44-89f9-a3711ed3c4bf tempest-CreateVolumesFromImageTest-1894321723 None] Volume 65903d9e-5528-4ea2-94af-55293bb4586e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65903d9e-5528-4ea2-94af-55293bb4586e', 'volume_size': 1}
Sep 18 12:12:56 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-b1af8cbe-3043-4b44-89f9-a3711ed3c4bf tempest-CreateVolumesFromImageTest-1894321723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:12:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-12479ee0-7957-4383-990f-028582c6cf2f tempest-CreateVolumesFromImageTest-1894321723 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b7be7c7d-43ef-40b9-9e14-bb5b10e937b8" returned: 0 in 0.580s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:57 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-12479ee0-7957-4383-990f-028582c6cf2f tempest-CreateVolumesFromImageTest-1894321723 None] <== create_volume: return (1286ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 12:12:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-12479ee0-7957-4383-990f-028582c6cf2f tempest-CreateVolumesFromImageTest-1894321723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.295s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:12:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f5ef5ca7-88e8-443e-9eb7-f59cff01458c tempest-CreateVolumesFromImageTest-1894321723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.463s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:12:57 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f5ef5ca7-88e8-443e-9eb7-f59cff01458c tempest-CreateVolumesFromImageTest-1894321723 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:12:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-138883650',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8ea8ceb-6be5-4a78-9d7d-b96072001a1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4e9b742f5e4faaa1750f7b3cb19da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:12:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:12:54Z,use_quota=True,user_id='04fb4f85bd7046bfb6cb8df7699f0748',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 12:12:57 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-f5ef5ca7-88e8-443e-9eb7-f59cff01458c tempest-CreateVolumesFromImageTest-1894321723 None] Creating volume a8ea8ceb-6be5-4a78-9d7d-b96072001a1b {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 12:12:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f5ef5ca7-88e8-443e-9eb7-f59cff01458c tempest-CreateVolumesFromImageTest-1894321723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:12:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f5ef5ca7-88e8-443e-9eb7-f59cff01458c tempest-CreateVolumesFromImageTest-1894321723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:12:57 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f5ef5ca7-88e8-443e-9eb7-f59cff01458c tempest-CreateVolumesFromImageTest-1894321723 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:12:57 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f5ef5ca7-88e8-443e-9eb7-f59cff01458c tempest-CreateVolumesFromImageTest-1894321723 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:12:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f5ef5ca7-88e8-443e-9eb7-f59cff01458c tempest-CreateVolumesFromImageTest-1894321723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:12:57 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f5ef5ca7-88e8-443e-9eb7-f59cff01458c tempest-CreateVolumesFromImageTest-1894321723 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 12:12:57 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-f5ef5ca7-88e8-443e-9eb7-f59cff01458c tempest-CreateVolumesFromImageTest-1894321723 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 12:12:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f5ef5ca7-88e8-443e-9eb7-f59cff01458c tempest-CreateVolumesFromImageTest-1894321723 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a8ea8ceb-6be5-4a78-9d7d-b96072001a1b 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:57 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=148, name=volume-a8ea8ceb-6be5-4a78-9d7d-b96072001a1b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:12:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-12479ee0-7957-4383-990f-028582c6cf2f tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9ca3ceb-a1da-431c-8057-87a830ddca5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7be7c7d-43ef-40b9-9e14-bb5b10e937b8', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-12479ee0-7957-4383-990f-028582c6cf2f tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c9e7471-dda7-4a85-89c8-53bf15e3d50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:57 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:12:57 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 12:12:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Flow 'volume_create_manager' (161b4c15-d522-455c-9218-673c20eab774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:12:57 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d3855c-b0f2-4642-9606-277fe13d9b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f5ef5ca7-88e8-443e-9eb7-f59cff01458c tempest-CreateVolumesFromImageTest-1894321723 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a8ea8ceb-6be5-4a78-9d7d-b96072001a1b 1073741824" returned: 0 in 0.719s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f5ef5ca7-88e8-443e-9eb7-f59cff01458c tempest-CreateVolumesFromImageTest-1894321723 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a8ea8ceb-6be5-4a78-9d7d-b96072001a1b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:57 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-12479ee0-7957-4383-990f-028582c6cf2f tempest-CreateVolumesFromImageTest-1894321723 None] Volume volume-b7be7c7d-43ef-40b9-9e14-bb5b10e937b8 (b7be7c7d-43ef-40b9-9e14-bb5b10e937b8): created successfully
Sep 18 12:12:58 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-12479ee0-7957-4383-990f-028582c6cf2f tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c9e7471-dda7-4a85-89c8-53bf15e3d50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:58 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-12479ee0-7957-4383-990f-028582c6cf2f tempest-CreateVolumesFromImageTest-1894321723 None] Flow 'volume_create_manager' (7225ea10-c505-426c-a629-6aed3b45b6fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:12:58 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d3855c-b0f2-4642-9606-277fe13d9b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3850cd9f-8e60-4811-8fa3-f53065c9c09b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='840d65997425438382eb277324a3f892',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:12:57Z,use_quota=True,user_id='20165a0bca354881bcac81b78f420b8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:58 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea17db15-ec88-4617-aa49-f14d4912845e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:58 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea17db15-ec88-4617-aa49-f14d4912845e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:58 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2af1666-6f90-4fdc-9985-345ce5f5f4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:58 devstack cinder-volume[83176]: DEBUG cinder.image.glance [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Creating Keystone auth plugin from conf {{(pid=83176) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 18 12:12:58 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-65e98397-95c7-461d-9c16-0180b32991ad tempest-CinderUnicodeTest-696598782 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:12:58 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-65e98397-95c7-461d-9c16-0180b32991ad tempest-CinderUnicodeTest-696598782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 12:12:58 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-65e98397-95c7-461d-9c16-0180b32991ad tempest-CinderUnicodeTest-696598782 None] Flow 'volume_create_manager' (f33f292d-84b4-43c9-9640-4a74aaa8cdaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:12:58 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-65e98397-95c7-461d-9c16-0180b32991ad tempest-CinderUnicodeTest-696598782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e80d640f-4b2c-42f4-b134-7f29d4a13638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:58 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-12479ee0-7957-4383-990f-028582c6cf2f tempest-CreateVolumesFromImageTest-1894321723 None] Created volume successfully.
Sep 18 12:12:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f5ef5ca7-88e8-443e-9eb7-f59cff01458c tempest-CreateVolumesFromImageTest-1894321723 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a8ea8ceb-6be5-4a78-9d7d-b96072001a1b" returned: 0 in 0.655s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:58 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f5ef5ca7-88e8-443e-9eb7-f59cff01458c tempest-CreateVolumesFromImageTest-1894321723 None] <== create_volume: return (1396ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 12:12:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f5ef5ca7-88e8-443e-9eb7-f59cff01458c tempest-CreateVolumesFromImageTest-1894321723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.404s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:12:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-70da7b54-c948-4f88-a5dc-5dc485f1e8cd tempest-CreateVolumesFromImageTest-1894321723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.760s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:12:58 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-70da7b54-c948-4f88-a5dc-5dc485f1e8cd tempest-CreateVolumesFromImageTest-1894321723 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-823811913',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=361b9d35-5de4-404b-a0bb-142b7ba65a9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4e9b742f5e4faaa1750f7b3cb19da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:12:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:12:54Z,use_quota=True,user_id='04fb4f85bd7046bfb6cb8df7699f0748',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 12:12:58 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-70da7b54-c948-4f88-a5dc-5dc485f1e8cd tempest-CreateVolumesFromImageTest-1894321723 None] Creating volume 361b9d35-5de4-404b-a0bb-142b7ba65a9e {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 12:12:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-70da7b54-c948-4f88-a5dc-5dc485f1e8cd tempest-CreateVolumesFromImageTest-1894321723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:12:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-70da7b54-c948-4f88-a5dc-5dc485f1e8cd tempest-CreateVolumesFromImageTest-1894321723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:12:58 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-70da7b54-c948-4f88-a5dc-5dc485f1e8cd tempest-CreateVolumesFromImageTest-1894321723 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:12:58 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-70da7b54-c948-4f88-a5dc-5dc485f1e8cd tempest-CreateVolumesFromImageTest-1894321723 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:12:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-70da7b54-c948-4f88-a5dc-5dc485f1e8cd tempest-CreateVolumesFromImageTest-1894321723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:12:58 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-70da7b54-c948-4f88-a5dc-5dc485f1e8cd tempest-CreateVolumesFromImageTest-1894321723 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 12:12:58 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-70da7b54-c948-4f88-a5dc-5dc485f1e8cd tempest-CreateVolumesFromImageTest-1894321723 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 12:12:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-70da7b54-c948-4f88-a5dc-5dc485f1e8cd tempest-CreateVolumesFromImageTest-1894321723 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-361b9d35-5de4-404b-a0bb-142b7ba65a9e 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:58 devstack quobyte-client[83193]: System call of process 100732 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 12:12:58 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=149, name=volume-361b9d35-5de4-404b-a0bb-142b7ba65a9e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:12:58 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-65e98397-95c7-461d-9c16-0180b32991ad tempest-CinderUnicodeTest-696598782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e80d640f-4b2c-42f4-b134-7f29d4a13638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:12:57Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1481549866',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9579f49-8739-4c98-b33c-7ce9ba1dddb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f641c489693474a95beb826e1f57c5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:12:57Z,use_quota=True,user_id='04525e46a410450abfb6c0f756d6c402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:58 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-65e98397-95c7-461d-9c16-0180b32991ad tempest-CinderUnicodeTest-696598782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf98c4fe-9599-4a7f-8536-ddf76762bad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:58 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-65e98397-95c7-461d-9c16-0180b32991ad tempest-CinderUnicodeTest-696598782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf98c4fe-9599-4a7f-8536-ddf76762bad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:58 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-65e98397-95c7-461d-9c16-0180b32991ad tempest-CinderUnicodeTest-696598782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3dcd7f8-c060-4aca-9e29-48a35d4f8c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:58 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-65e98397-95c7-461d-9c16-0180b32991ad tempest-CinderUnicodeTest-696598782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3dcd7f8-c060-4aca-9e29-48a35d4f8c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9579f49-8739-4c98-b33c-7ce9ba1dddb7', 'volume_name': 'volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:58 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-65e98397-95c7-461d-9c16-0180b32991ad tempest-CinderUnicodeTest-696598782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8aa2f6d-b9d7-422a-bfd9-b8bd25c66313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:58 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-65e98397-95c7-461d-9c16-0180b32991ad tempest-CinderUnicodeTest-696598782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8aa2f6d-b9d7-422a-bfd9-b8bd25c66313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:58 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-65e98397-95c7-461d-9c16-0180b32991ad tempest-CinderUnicodeTest-696598782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94b7150b-226a-46f7-9043-09f2c5352f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:58 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-65e98397-95c7-461d-9c16-0180b32991ad tempest-CinderUnicodeTest-696598782 None] Volume a9579f49-8739-4c98-b33c-7ce9ba1dddb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7', 'volume_size': 1}
Sep 18 12:12:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-65e98397-95c7-461d-9c16-0180b32991ad tempest-CinderUnicodeTest-696598782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:12:59 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f5ef5ca7-88e8-443e-9eb7-f59cff01458c tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea145129-d0b8-4bbd-b87a-ecd6a4904b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8ea8ceb-6be5-4a78-9d7d-b96072001a1b', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:59 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f5ef5ca7-88e8-443e-9eb7-f59cff01458c tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0280ef0a-5295-4b62-a5fe-be6772d71583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:12:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-70da7b54-c948-4f88-a5dc-5dc485f1e8cd tempest-CreateVolumesFromImageTest-1894321723 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-361b9d35-5de4-404b-a0bb-142b7ba65a9e 1073741824" returned: 0 in 0.707s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-70da7b54-c948-4f88-a5dc-5dc485f1e8cd tempest-CreateVolumesFromImageTest-1894321723 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-361b9d35-5de4-404b-a0bb-142b7ba65a9e {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:59 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-f5ef5ca7-88e8-443e-9eb7-f59cff01458c tempest-CreateVolumesFromImageTest-1894321723 None] Volume volume-a8ea8ceb-6be5-4a78-9d7d-b96072001a1b (a8ea8ceb-6be5-4a78-9d7d-b96072001a1b): created successfully
Sep 18 12:12:59 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f5ef5ca7-88e8-443e-9eb7-f59cff01458c tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0280ef0a-5295-4b62-a5fe-be6772d71583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:12:59 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f5ef5ca7-88e8-443e-9eb7-f59cff01458c tempest-CreateVolumesFromImageTest-1894321723 None] Flow 'volume_create_manager' (1373406c-3ae0-454e-bdf3-8daba213a5fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:12:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-70da7b54-c948-4f88-a5dc-5dc485f1e8cd tempest-CreateVolumesFromImageTest-1894321723 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-361b9d35-5de4-404b-a0bb-142b7ba65a9e" returned: 0 in 0.450s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:12:59 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-70da7b54-c948-4f88-a5dc-5dc485f1e8cd tempest-CreateVolumesFromImageTest-1894321723 None] <== create_volume: return (1204ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 12:12:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-70da7b54-c948-4f88-a5dc-5dc485f1e8cd tempest-CreateVolumesFromImageTest-1894321723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:12:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d92a3dc7-d6ff-4a67-a997-dc684c5a2c9c tempest-CreateVolumesFromImageTest-1894321723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.328s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:12:59 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-d92a3dc7-d6ff-4a67-a997-dc684c5a2c9c tempest-CreateVolumesFromImageTest-1894321723 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1302687165',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bccee59a-7f40-40e3-8f11-e668ae2c2b19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4e9b742f5e4faaa1750f7b3cb19da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:12:55Z,use_quota=True,user_id='04fb4f85bd7046bfb6cb8df7699f0748',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 12:12:59 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-d92a3dc7-d6ff-4a67-a997-dc684c5a2c9c tempest-CreateVolumesFromImageTest-1894321723 None] Creating volume bccee59a-7f40-40e3-8f11-e668ae2c2b19 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 12:12:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d92a3dc7-d6ff-4a67-a997-dc684c5a2c9c tempest-CreateVolumesFromImageTest-1894321723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:12:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d92a3dc7-d6ff-4a67-a997-dc684c5a2c9c tempest-CreateVolumesFromImageTest-1894321723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:12:59 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-d92a3dc7-d6ff-4a67-a997-dc684c5a2c9c tempest-CreateVolumesFromImageTest-1894321723 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:12:59 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-d92a3dc7-d6ff-4a67-a997-dc684c5a2c9c tempest-CreateVolumesFromImageTest-1894321723 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:12:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d92a3dc7-d6ff-4a67-a997-dc684c5a2c9c tempest-CreateVolumesFromImageTest-1894321723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:12:59 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-d92a3dc7-d6ff-4a67-a997-dc684c5a2c9c tempest-CreateVolumesFromImageTest-1894321723 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 12:12:59 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-d92a3dc7-d6ff-4a67-a997-dc684c5a2c9c tempest-CreateVolumesFromImageTest-1894321723 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 12:12:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d92a3dc7-d6ff-4a67-a997-dc684c5a2c9c tempest-CreateVolumesFromImageTest-1894321723 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-bccee59a-7f40-40e3-8f11-e668ae2c2b19 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:12:59 devstack quobyte-client[83193]: System call of process 100737 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 12:12:59 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=150, name=volume-bccee59a-7f40-40e3-8f11-e668ae2c2b19, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:13:00 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-f5ef5ca7-88e8-443e-9eb7-f59cff01458c tempest-CreateVolumesFromImageTest-1894321723 None] Created volume successfully.
Sep 18 12:13:00 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-70da7b54-c948-4f88-a5dc-5dc485f1e8cd tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c39d65a-8164-40d0-8352-7e9d24527dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-361b9d35-5de4-404b-a0bb-142b7ba65a9e', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:00 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-70da7b54-c948-4f88-a5dc-5dc485f1e8cd tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe3d4d4f-deab-44d3-b5f9-0cbea797f137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:13:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d92a3dc7-d6ff-4a67-a997-dc684c5a2c9c tempest-CreateVolumesFromImageTest-1894321723 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-bccee59a-7f40-40e3-8f11-e668ae2c2b19 1073741824" returned: 0 in 0.508s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d92a3dc7-d6ff-4a67-a997-dc684c5a2c9c tempest-CreateVolumesFromImageTest-1894321723 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-bccee59a-7f40-40e3-8f11-e668ae2c2b19 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:00 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2af1666-6f90-4fdc-9985-345ce5f5f4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3850cd9f-8e60-4811-8fa3-f53065c9c09b', 'volume_name': 'volume-3850cd9f-8e60-4811-8fa3-f53065c9c09b', 'volume_size': 1, 'image_id': '01cd37b3-d6c5-4e75-9b86-b4ded794c4f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/01cd37b3-d6c5-4e75-9b86-b4ded794c4f2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5e2667c8b2b2fdced220008e85575f96', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '840d65997425438382eb277324a3f892', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a759a0bb4ceca856abf7fc8b398cead8e81a6a49cca25e353d1dca48ec13fc0a6b8a1a2fe0fffcdf84abf35eb95ea935264c199523e8e25a4dbb1975c1bdfc71', 'id': '01cd37b3-d6c5-4e75-9b86-b4ded794c4f2', 'created_at': datetime.datetime(2025, 9, 18, 10, 12, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 10, 12, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/01cd37b3-d6c5-4e75-9b86-b4ded794c4f2/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6ada045750>}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:00 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (304f92f3-e136-499d-a7f1-0a7fa9804bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:13:00 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (304f92f3-e136-499d-a7f1-0a7fa9804bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:00 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fea3c0fc-53f4-46c9-97e0-9708d5f6bf83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:13:00 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Volume 3850cd9f-8e60-4811-8fa3-f53065c9c09b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3850cd9f-8e60-4811-8fa3-f53065c9c09b', 'volume_size': 1, 'image_id': '01cd37b3-d6c5-4e75-9b86-b4ded794c4f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/01cd37b3-d6c5-4e75-9b86-b4ded794c4f2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5e2667c8b2b2fdced220008e85575f96', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '840d65997425438382eb277324a3f892', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a759a0bb4ceca856abf7fc8b398cead8e81a6a49cca25e353d1dca48ec13fc0a6b8a1a2fe0fffcdf84abf35eb95ea935264c199523e8e25a4dbb1975c1bdfc71', 'id': '01cd37b3-d6c5-4e75-9b86-b4ded794c4f2', 'created_at': datetime.datetime(2025, 9, 18, 10, 12, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 10, 12, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/01cd37b3-d6c5-4e75-9b86-b4ded794c4f2/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6ada045750>}
Sep 18 12:13:00 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Cloning 3850cd9f-8e60-4811-8fa3-f53065c9c09b from image 01cd37b3-d6c5-4e75-9b86-b4ded794c4f2  at location (None, [{'url': 'file:///opt/stack/data/glance/images/01cd37b3-d6c5-4e75-9b86-b4ded794c4f2', 'metadata': {}}]). {{(pid=83176) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 18 12:13:00 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-70da7b54-c948-4f88-a5dc-5dc485f1e8cd tempest-CreateVolumesFromImageTest-1894321723 None] Volume volume-361b9d35-5de4-404b-a0bb-142b7ba65a9e (361b9d35-5de4-404b-a0bb-142b7ba65a9e): created successfully
Sep 18 12:13:00 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-70da7b54-c948-4f88-a5dc-5dc485f1e8cd tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe3d4d4f-deab-44d3-b5f9-0cbea797f137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:00 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-70da7b54-c948-4f88-a5dc-5dc485f1e8cd tempest-CreateVolumesFromImageTest-1894321723 None] Flow 'volume_create_manager' (7c54753b-dfe5-4452-b209-abb240011034) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:13:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-d92a3dc7-d6ff-4a67-a997-dc684c5a2c9c tempest-CreateVolumesFromImageTest-1894321723 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-bccee59a-7f40-40e3-8f11-e668ae2c2b19" returned: 0 in 0.517s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:00 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-d92a3dc7-d6ff-4a67-a997-dc684c5a2c9c tempest-CreateVolumesFromImageTest-1894321723 None] <== create_volume: return (1043ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 12:13:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-d92a3dc7-d6ff-4a67-a997-dc684c5a2c9c tempest-CreateVolumesFromImageTest-1894321723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:13:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-b1af8cbe-3043-4b44-89f9-a3711ed3c4bf tempest-CreateVolumesFromImageTest-1894321723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.822s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:13:00 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-b1af8cbe-3043-4b44-89f9-a3711ed3c4bf tempest-CreateVolumesFromImageTest-1894321723 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-848010112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65903d9e-5528-4ea2-94af-55293bb4586e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4e9b742f5e4faaa1750f7b3cb19da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:12:55Z,use_quota=True,user_id='04fb4f85bd7046bfb6cb8df7699f0748',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 12:13:00 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-b1af8cbe-3043-4b44-89f9-a3711ed3c4bf tempest-CreateVolumesFromImageTest-1894321723 None] Creating volume 65903d9e-5528-4ea2-94af-55293bb4586e {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 12:13:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-b1af8cbe-3043-4b44-89f9-a3711ed3c4bf tempest-CreateVolumesFromImageTest-1894321723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:13:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-b1af8cbe-3043-4b44-89f9-a3711ed3c4bf tempest-CreateVolumesFromImageTest-1894321723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:13:00 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-b1af8cbe-3043-4b44-89f9-a3711ed3c4bf tempest-CreateVolumesFromImageTest-1894321723 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:13:00 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-b1af8cbe-3043-4b44-89f9-a3711ed3c4bf tempest-CreateVolumesFromImageTest-1894321723 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:13:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-b1af8cbe-3043-4b44-89f9-a3711ed3c4bf tempest-CreateVolumesFromImageTest-1894321723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:13:00 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-b1af8cbe-3043-4b44-89f9-a3711ed3c4bf tempest-CreateVolumesFromImageTest-1894321723 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 12:13:00 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-b1af8cbe-3043-4b44-89f9-a3711ed3c4bf tempest-CreateVolumesFromImageTest-1894321723 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 12:13:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b1af8cbe-3043-4b44-89f9-a3711ed3c4bf tempest-CreateVolumesFromImageTest-1894321723 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-65903d9e-5528-4ea2-94af-55293bb4586e 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:00 devstack quobyte-client[83193]: System call of process 100741 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 12:13:00 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=151, name=volume-65903d9e-5528-4ea2-94af-55293bb4586e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:13:01 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-70da7b54-c948-4f88-a5dc-5dc485f1e8cd tempest-CreateVolumesFromImageTest-1894321723 None] Created volume successfully.
Sep 18 12:13:01 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d92a3dc7-d6ff-4a67-a997-dc684c5a2c9c tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ed41da1-9010-40c6-b254-11bb8457cd2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bccee59a-7f40-40e3-8f11-e668ae2c2b19', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:01 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d92a3dc7-d6ff-4a67-a997-dc684c5a2c9c tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a68d003-9694-4a52-9426-cb30ce466ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:13:01 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_01cd37b3-d6c5-4e75-9b86-b4ded794c4f2_v2_xhmbqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=83176) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 18 12:13:01 devstack cinder-volume[83176]: INFO cinder.image.image_utils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Image download 0.00 MB at 0.00 MB/s
Sep 18 12:13:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b1af8cbe-3043-4b44-89f9-a3711ed3c4bf tempest-CreateVolumesFromImageTest-1894321723 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-65903d9e-5528-4ea2-94af-55293bb4586e 1073741824" returned: 0 in 0.633s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b1af8cbe-3043-4b44-89f9-a3711ed3c4bf tempest-CreateVolumesFromImageTest-1894321723 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-65903d9e-5528-4ea2-94af-55293bb4586e {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:01 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-d92a3dc7-d6ff-4a67-a997-dc684c5a2c9c tempest-CreateVolumesFromImageTest-1894321723 None] Volume volume-bccee59a-7f40-40e3-8f11-e668ae2c2b19 (bccee59a-7f40-40e3-8f11-e668ae2c2b19): created successfully
Sep 18 12:13:01 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d92a3dc7-d6ff-4a67-a997-dc684c5a2c9c tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a68d003-9694-4a52-9426-cb30ce466ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:01 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-d92a3dc7-d6ff-4a67-a997-dc684c5a2c9c tempest-CreateVolumesFromImageTest-1894321723 None] Flow 'volume_create_manager' (7d67ed38-5129-40ad-859a-ea1bccbf7d3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:13:01 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-d92a3dc7-d6ff-4a67-a997-dc684c5a2c9c tempest-CreateVolumesFromImageTest-1894321723 None] Created volume successfully.
Sep 18 12:13:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-b1af8cbe-3043-4b44-89f9-a3711ed3c4bf tempest-CreateVolumesFromImageTest-1894321723 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-65903d9e-5528-4ea2-94af-55293bb4586e" returned: 0 in 0.414s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:01 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-b1af8cbe-3043-4b44-89f9-a3711ed3c4bf tempest-CreateVolumesFromImageTest-1894321723 None] <== create_volume: return (1104ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 12:13:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-b1af8cbe-3043-4b44-89f9-a3711ed3c4bf tempest-CreateVolumesFromImageTest-1894321723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:13:01 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[666450a4-9659-4fa2-b754-068bf1caa505]: (4, 'raw') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:13:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-65e98397-95c7-461d-9c16-0180b32991ad tempest-CinderUnicodeTest-696598782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.989s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:13:01 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-65e98397-95c7-461d-9c16-0180b32991ad tempest-CinderUnicodeTest-696598782 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:12:57Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1481549866',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9579f49-8739-4c98-b33c-7ce9ba1dddb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f641c489693474a95beb826e1f57c5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:12:57Z,use_quota=True,user_id='04525e46a410450abfb6c0f756d6c402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 12:13:01 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-65e98397-95c7-461d-9c16-0180b32991ad tempest-CinderUnicodeTest-696598782 None] Creating volume a9579f49-8739-4c98-b33c-7ce9ba1dddb7 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 12:13:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-65e98397-95c7-461d-9c16-0180b32991ad tempest-CinderUnicodeTest-696598782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:13:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-65e98397-95c7-461d-9c16-0180b32991ad tempest-CinderUnicodeTest-696598782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:13:01 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-65e98397-95c7-461d-9c16-0180b32991ad tempest-CinderUnicodeTest-696598782 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:13:01 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-65e98397-95c7-461d-9c16-0180b32991ad tempest-CinderUnicodeTest-696598782 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:13:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-65e98397-95c7-461d-9c16-0180b32991ad tempest-CinderUnicodeTest-696598782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:13:01 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-65e98397-95c7-461d-9c16-0180b32991ad tempest-CinderUnicodeTest-696598782 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 12:13:01 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-65e98397-95c7-461d-9c16-0180b32991ad tempest-CinderUnicodeTest-696598782 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 12:13:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-65e98397-95c7-461d-9c16-0180b32991ad tempest-CinderUnicodeTest-696598782 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01cd37b3-d6c5-4e75-9b86-b4ded794c4f2_v2_xhmbqdevstack@QuobyteHD {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:02 devstack quobyte-client[83193]: System call of process 100745 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 12:13:02 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=152, name=volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:13:02 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b1af8cbe-3043-4b44-89f9-a3711ed3c4bf tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba2960b1-7b8f-4425-8071-393ae4a97df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65903d9e-5528-4ea2-94af-55293bb4586e', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:02 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b1af8cbe-3043-4b44-89f9-a3711ed3c4bf tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f1209cd-15d5-47dc-a98e-9e4b763f0cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:13:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-65e98397-95c7-461d-9c16-0180b32991ad tempest-CinderUnicodeTest-696598782 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7 1073741824" returned: 0 in 0.521s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-65e98397-95c7-461d-9c16-0180b32991ad tempest-CinderUnicodeTest-696598782 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:02 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-b1af8cbe-3043-4b44-89f9-a3711ed3c4bf tempest-CreateVolumesFromImageTest-1894321723 None] Volume volume-65903d9e-5528-4ea2-94af-55293bb4586e (65903d9e-5528-4ea2-94af-55293bb4586e): created successfully
Sep 18 12:13:02 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b1af8cbe-3043-4b44-89f9-a3711ed3c4bf tempest-CreateVolumesFromImageTest-1894321723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f1209cd-15d5-47dc-a98e-9e4b763f0cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:02 devstack sudo[100747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01cd37b3-d6c5-4e75-9b86-b4ded794c4f2_v2_xhmbqdevstack@QuobyteHD
Sep 18 12:13:02 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-b1af8cbe-3043-4b44-89f9-a3711ed3c4bf tempest-CreateVolumesFromImageTest-1894321723 None] Flow 'volume_create_manager' (0e0949bb-4d3e-4545-8487-36691664e8ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:13:02 devstack sudo[100747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 12:13:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-65e98397-95c7-461d-9c16-0180b32991ad tempest-CinderUnicodeTest-696598782 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7" returned: 0 in 0.378s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:02 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-65e98397-95c7-461d-9c16-0180b32991ad tempest-CinderUnicodeTest-696598782 None] <== create_volume: return (925ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 12:13:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-65e98397-95c7-461d-9c16-0180b32991ad tempest-CinderUnicodeTest-696598782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:13:02 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-b1af8cbe-3043-4b44-89f9-a3711ed3c4bf tempest-CreateVolumesFromImageTest-1894321723 None] Created volume successfully.
Sep 18 12:13:02 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-65e98397-95c7-461d-9c16-0180b32991ad tempest-CinderUnicodeTest-696598782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94b7150b-226a-46f7-9043-09f2c5352f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:02 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-65e98397-95c7-461d-9c16-0180b32991ad tempest-CinderUnicodeTest-696598782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (358e80c0-21f6-457c-82db-fe985701a670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:13:03 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-65e98397-95c7-461d-9c16-0180b32991ad tempest-CinderUnicodeTest-696598782 None] Volume volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7 (a9579f49-8739-4c98-b33c-7ce9ba1dddb7): created successfully
Sep 18 12:13:03 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-65e98397-95c7-461d-9c16-0180b32991ad tempest-CinderUnicodeTest-696598782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (358e80c0-21f6-457c-82db-fe985701a670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:03 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-65e98397-95c7-461d-9c16-0180b32991ad tempest-CinderUnicodeTest-696598782 None] Flow 'volume_create_manager' (f33f292d-84b4-43c9-9640-4a74aaa8cdaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:13:03 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-65e98397-95c7-461d-9c16-0180b32991ad tempest-CinderUnicodeTest-696598782 None] Created volume successfully.
Sep 18 12:13:03 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-9cb9f7c4-7d53-47b6-8164-dbb50ea1a501 tempest-CreateVolumesFromImageTest-1894321723 None] Acquiring lock "cinder-bccee59a-7f40-40e3-8f11-e668ae2c2b19-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:13:03 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-9cb9f7c4-7d53-47b6-8164-dbb50ea1a501 tempest-CreateVolumesFromImageTest-1894321723 None] Lock "cinder-bccee59a-7f40-40e3-8f11-e668ae2c2b19-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:13:04 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-9cb9f7c4-7d53-47b6-8164-dbb50ea1a501 tempest-CreateVolumesFromImageTest-1894321723 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:13:04 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-9cb9f7c4-7d53-47b6-8164-dbb50ea1a501 tempest-CreateVolumesFromImageTest-1894321723 None] Acquiring lock "cinder-quobyte-bccee59a-7f40-40e3-8f11-e668ae2c2b19" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:13:04 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-9cb9f7c4-7d53-47b6-8164-dbb50ea1a501 tempest-CreateVolumesFromImageTest-1894321723 None] Lock "cinder-quobyte-bccee59a-7f40-40e3-8f11-e668ae2c2b19" acquired by "delete_volume" :: waited 0.015s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:13:04 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b513880-8d06-4372-8417-dce8481b919a]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:13:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9cb9f7c4-7d53-47b6-8164-dbb50ea1a501 tempest-CreateVolumesFromImageTest-1894321723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-bccee59a-7f40-40e3-8f11-e668ae2c2b19 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:05 devstack sudo[100747]: pam_unix(sudo:session): session closed for user root
Sep 18 12:13:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01cd37b3-d6c5-4e75-9b86-b4ded794c4f2_v2_xhmbqdevstack@QuobyteHD" returned: 0 in 3.304s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01cd37b3-d6c5-4e75-9b86-b4ded794c4f2_v2_xhmbqdevstack@QuobyteHD {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:05 devstack quobyte-client[83193]: System call of process 100759 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 12:13:05 devstack quobyte-client[83193]: System call of process 100759 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 12:13:05 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-5a12a9ec-47b8-49c3-8824-e630726f9a10 tempest-CinderUnicodeTest-696598782 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:13:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-5a12a9ec-47b8-49c3-8824-e630726f9a10 tempest-CinderUnicodeTest-696598782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:13:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-5a12a9ec-47b8-49c3-8824-e630726f9a10 tempest-CinderUnicodeTest-696598782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:13:05 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-5a12a9ec-47b8-49c3-8824-e630726f9a10 tempest-CinderUnicodeTest-696598782 None] Creating offline snapshot c8a5b667-86c5-44cf-b7a8-303f018cb325 of volume a9579f49-8739-4c98-b33c-7ce9ba1dddb7 {{(pid=83176) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 12:13:06 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9cb9f7c4-7d53-47b6-8164-dbb50ea1a501 tempest-CreateVolumesFromImageTest-1894321723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-bccee59a-7f40-40e3-8f11-e668ae2c2b19" returned: 0 in 1.847s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:06 devstack sudo[100791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01cd37b3-d6c5-4e75-9b86-b4ded794c4f2_v2_xhmbqdevstack@QuobyteHD
Sep 18 12:13:06 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9cb9f7c4-7d53-47b6-8164-dbb50ea1a501 tempest-CreateVolumesFromImageTest-1894321723 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-bccee59a-7f40-40e3-8f11-e668ae2c2b19 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:06 devstack sudo[100791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 12:13:06 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e657e0c-f20e-4143-a75a-9f80a5c15846]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:13:06 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5a12a9ec-47b8-49c3-8824-e630726f9a10 tempest-CinderUnicodeTest-696598782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:06 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9cb9f7c4-7d53-47b6-8164-dbb50ea1a501 tempest-CreateVolumesFromImageTest-1894321723 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-bccee59a-7f40-40e3-8f11-e668ae2c2b19" returned: 0 in 0.266s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:06 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-9cb9f7c4-7d53-47b6-8164-dbb50ea1a501 tempest-CreateVolumesFromImageTest-1894321723 None] Lock "cinder-quobyte-bccee59a-7f40-40e3-8f11-e668ae2c2b19" released by "delete_volume" :: held 2.368s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:13:06 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-9cb9f7c4-7d53-47b6-8164-dbb50ea1a501 tempest-CreateVolumesFromImageTest-1894321723 None] Created reservations ['f942b4d5-14d9-45fc-bed2-a883d8d34831', '2de1f73b-fab8-4be6-842c-d0374d7a547f', '59f75c74-85ec-48a6-a1eb-2dc05901fe75', 'bad85df1-3d32-46d1-9435-7f3e137adfe9'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:13:07 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5a12a9ec-47b8-49c3-8824-e630726f9a10 tempest-CinderUnicodeTest-696598782 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7" returned: 0 in 0.840s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:07 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5a12a9ec-47b8-49c3-8824-e630726f9a10 tempest-CinderUnicodeTest-696598782 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7.c8a5b667-86c5-44cf-b7a8-303f018cb325 1G {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:07 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-9cb9f7c4-7d53-47b6-8164-dbb50ea1a501 tempest-CreateVolumesFromImageTest-1894321723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:13:07 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-9cb9f7c4-7d53-47b6-8164-dbb50ea1a501 tempest-CreateVolumesFromImageTest-1894321723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.058s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:13:07 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-9cb9f7c4-7d53-47b6-8164-dbb50ea1a501 tempest-CreateVolumesFromImageTest-1894321723 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:13:07 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-9cb9f7c4-7d53-47b6-8164-dbb50ea1a501 tempest-CreateVolumesFromImageTest-1894321723 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:13:07 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-9cb9f7c4-7d53-47b6-8164-dbb50ea1a501 tempest-CreateVolumesFromImageTest-1894321723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:13:07 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9cb9f7c4-7d53-47b6-8164-dbb50ea1a501 tempest-CreateVolumesFromImageTest-1894321723 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:07 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=153, name=volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7.c8a5b667-86c5-44cf-b7a8-303f018cb325, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:13:07 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-39c5f14e-aa3a-430e-bf65-edeaaa7790eb tempest-CreateVolumesFromImageTest-1894321723 None] Acquiring lock "cinder-65903d9e-5528-4ea2-94af-55293bb4586e-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:13:07 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5a12a9ec-47b8-49c3-8824-e630726f9a10 tempest-CinderUnicodeTest-696598782 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7.c8a5b667-86c5-44cf-b7a8-303f018cb325 1G" returned: 0 in 0.721s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:07 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5a12a9ec-47b8-49c3-8824-e630726f9a10 tempest-CinderUnicodeTest-696598782 None] Running cmd (subprocess): qemu-img rebase -u -b volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7 -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7.c8a5b667-86c5-44cf-b7a8-303f018cb325 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:07 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-9cb9f7c4-7d53-47b6-8164-dbb50ea1a501 tempest-CreateVolumesFromImageTest-1894321723 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.563s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:08 devstack quobyte-client[83193]: System call of process 100808 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 12:13:08 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-9cb9f7c4-7d53-47b6-8164-dbb50ea1a501 tempest-CreateVolumesFromImageTest-1894321723 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:13:08 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-9cb9f7c4-7d53-47b6-8164-dbb50ea1a501 tempest-CreateVolumesFromImageTest-1894321723 None] Deleted volume successfully.
Sep 18 12:13:08 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-39c5f14e-aa3a-430e-bf65-edeaaa7790eb tempest-CreateVolumesFromImageTest-1894321723 None] Lock "cinder-65903d9e-5528-4ea2-94af-55293bb4586e-delete_volume" acquired by "delete_volume" :: waited 0.795s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:13:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5a12a9ec-47b8-49c3-8824-e630726f9a10 tempest-CinderUnicodeTest-696598782 None] CMD "qemu-img rebase -u -b volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7 -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7.c8a5b667-86c5-44cf-b7a8-303f018cb325" returned: 0 in 0.647s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:08 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-5a12a9ec-47b8-49c3-8824-e630726f9a10 tempest-CinderUnicodeTest-696598782 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7.c8a5b667-86c5-44cf-b7a8-303f018cb325 is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 12:13:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5a12a9ec-47b8-49c3-8824-e630726f9a10 tempest-CinderUnicodeTest-696598782 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7.c8a5b667-86c5-44cf-b7a8-303f018cb325 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:08 devstack sudo[100791]: pam_unix(sudo:session): session closed for user root
Sep 18 12:13:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5a12a9ec-47b8-49c3-8824-e630726f9a10 tempest-CinderUnicodeTest-696598782 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7.c8a5b667-86c5-44cf-b7a8-303f018cb325" returned: 0 in 0.386s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01cd37b3-d6c5-4e75-9b86-b4ded794c4f2_v2_xhmbqdevstack@QuobyteHD" returned: 1 in 3.472s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01cd37b3-d6c5-4e75-9b86-b4ded794c4f2_v2_xhmbqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 12:13:08 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-9cb9f7c4-7d53-47b6-8164-dbb50ea1a501 tempest-CreateVolumesFromImageTest-1894321723 None] Lock "cinder-bccee59a-7f40-40e3-8f11-e668ae2c2b19-delete_volume" released by "delete_volume" :: held 4.980s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:13:08 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-5a12a9ec-47b8-49c3-8824-e630726f9a10 tempest-CinderUnicodeTest-696598782 None] Setting permissions: /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7 -> 1000:1000 {{(pid=83176) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 12:13:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5a12a9ec-47b8-49c3-8824-e630726f9a10 tempest-CinderUnicodeTest-696598782 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7.c8a5b667-86c5-44cf-b7a8-303f018cb325 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:08 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Temporary image 01cd37b3-d6c5-4e75-9b86-b4ded794c4f2 is fetched for user 20165a0bca354881bcac81b78f420b8f. {{(pid=83176) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 18 12:13:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5a12a9ec-47b8-49c3-8824-e630726f9a10 tempest-CinderUnicodeTest-696598782 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7.c8a5b667-86c5-44cf-b7a8-303f018cb325" returned: 0 in 0.282s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5a12a9ec-47b8-49c3-8824-e630726f9a10 tempest-CinderUnicodeTest-696598782 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7.info {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5a12a9ec-47b8-49c3-8824-e630726f9a10 tempest-CinderUnicodeTest-696598782 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7.info" returned: 0 in 0.410s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:09 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-5a12a9ec-47b8-49c3-8824-e630726f9a10 tempest-CinderUnicodeTest-696598782 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7.info is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 12:13:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5a12a9ec-47b8-49c3-8824-e630726f9a10 tempest-CinderUnicodeTest-696598782 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7.info {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:09 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-39c5f14e-aa3a-430e-bf65-edeaaa7790eb tempest-CreateVolumesFromImageTest-1894321723 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:13:09 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-39c5f14e-aa3a-430e-bf65-edeaaa7790eb tempest-CreateVolumesFromImageTest-1894321723 None] Acquiring lock "cinder-quobyte-65903d9e-5528-4ea2-94af-55293bb4586e" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:13:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5a12a9ec-47b8-49c3-8824-e630726f9a10 tempest-CinderUnicodeTest-696598782 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7.info" returned: 0 in 0.389s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-5a12a9ec-47b8-49c3-8824-e630726f9a10 tempest-CinderUnicodeTest-696598782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.387s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:13:10 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[592b8aab-0802-4471-a573-2adb7f267983]: (4, 'raw') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:13:10 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-39c5f14e-aa3a-430e-bf65-edeaaa7790eb tempest-CreateVolumesFromImageTest-1894321723 None] Lock "cinder-quobyte-65903d9e-5528-4ea2-94af-55293bb4586e" acquired by "delete_volume" :: waited 0.194s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:13:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01cd37b3-d6c5-4e75-9b86-b4ded794c4f2_v2_xhmbqdevstack@QuobyteHD {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:10 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a53e71-6126-4277-af07-3b8ed8e894c9]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:13:10 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-39c5f14e-aa3a-430e-bf65-edeaaa7790eb tempest-CreateVolumesFromImageTest-1894321723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-65903d9e-5528-4ea2-94af-55293bb4586e {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:10 devstack sudo[100815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01cd37b3-d6c5-4e75-9b86-b4ded794c4f2_v2_xhmbqdevstack@QuobyteHD
Sep 18 12:13:10 devstack sudo[100815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 12:13:10 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-5a12a9ec-47b8-49c3-8824-e630726f9a10 tempest-CinderUnicodeTest-696598782 None] Create snapshot completed successfully
Sep 18 12:13:11 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-39c5f14e-aa3a-430e-bf65-edeaaa7790eb tempest-CreateVolumesFromImageTest-1894321723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-65903d9e-5528-4ea2-94af-55293bb4586e" returned: 0 in 0.669s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:11 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-39c5f14e-aa3a-430e-bf65-edeaaa7790eb tempest-CreateVolumesFromImageTest-1894321723 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-65903d9e-5528-4ea2-94af-55293bb4586e {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:11 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-39c5f14e-aa3a-430e-bf65-edeaaa7790eb tempest-CreateVolumesFromImageTest-1894321723 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-65903d9e-5528-4ea2-94af-55293bb4586e" returned: 0 in 0.126s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:11 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-39c5f14e-aa3a-430e-bf65-edeaaa7790eb tempest-CreateVolumesFromImageTest-1894321723 None] Lock "cinder-quobyte-65903d9e-5528-4ea2-94af-55293bb4586e" released by "delete_volume" :: held 1.285s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:13:11 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-fbfb4633-2d22-4856-94e9-959005cbf0cc tempest-CinderUnicodeTest-696598782 None] Acquiring lock "cinder-c8a5b667-86c5-44cf-b7a8-303f018cb325-delete_snapshot" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:13:11 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-fbfb4633-2d22-4856-94e9-959005cbf0cc tempest-CinderUnicodeTest-696598782 None] Lock "cinder-c8a5b667-86c5-44cf-b7a8-303f018cb325-delete_snapshot" acquired by "delete_snapshot" :: waited 0.077s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:13:11 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-fbfb4633-2d22-4856-94e9-959005cbf0cc tempest-CinderUnicodeTest-696598782 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:13:11 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-fbfb4633-2d22-4856-94e9-959005cbf0cc tempest-CinderUnicodeTest-696598782 None] Acquiring lock "cinder-quobyte-a9579f49-8739-4c98-b33c-7ce9ba1dddb7" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:13:11 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-fbfb4633-2d22-4856-94e9-959005cbf0cc tempest-CinderUnicodeTest-696598782 None] Lock "cinder-quobyte-a9579f49-8739-4c98-b33c-7ce9ba1dddb7" acquired by "delete_snapshot" :: waited 0.078s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:13:11 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-fbfb4633-2d22-4856-94e9-959005cbf0cc tempest-CinderUnicodeTest-696598782 None] Acquiring lock "cinder-quobyte-c8a5b667-86c5-44cf-b7a8-303f018cb325" by "_delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:13:11 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-fbfb4633-2d22-4856-94e9-959005cbf0cc tempest-CinderUnicodeTest-696598782 None] Lock "cinder-quobyte-c8a5b667-86c5-44cf-b7a8-303f018cb325" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:13:11 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-fbfb4633-2d22-4856-94e9-959005cbf0cc tempest-CinderUnicodeTest-696598782 None] Deleting offline snapshot c8a5b667-86c5-44cf-b7a8-303f018cb325 of volume a9579f49-8739-4c98-b33c-7ce9ba1dddb7 {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 12:13:11 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-fbfb4633-2d22-4856-94e9-959005cbf0cc tempest-CinderUnicodeTest-696598782 None] snapshot_file for this snap is: volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7.c8a5b667-86c5-44cf-b7a8-303f018cb325 {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 12:13:11 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-39c5f14e-aa3a-430e-bf65-edeaaa7790eb tempest-CreateVolumesFromImageTest-1894321723 None] Created reservations ['9f1a6790-e2d0-4563-a6be-d26a060fc58f', '2ad562c4-bd56-4a9f-afee-87bde34b1bec', '446b3dde-3991-4565-9942-4e71104a821b', '5c682720-7177-41e9-84ed-c15cd5bd68fd'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:13:11 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb71684-2e5f-43f0-a396-3a7613e97078]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:13:11 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fbfb4633-2d22-4856-94e9-959005cbf0cc tempest-CinderUnicodeTest-696598782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7.c8a5b667-86c5-44cf-b7a8-303f018cb325 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-39c5f14e-aa3a-430e-bf65-edeaaa7790eb tempest-CreateVolumesFromImageTest-1894321723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:13:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-39c5f14e-aa3a-430e-bf65-edeaaa7790eb tempest-CreateVolumesFromImageTest-1894321723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.038s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:13:12 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-39c5f14e-aa3a-430e-bf65-edeaaa7790eb tempest-CreateVolumesFromImageTest-1894321723 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:13:12 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-39c5f14e-aa3a-430e-bf65-edeaaa7790eb tempest-CreateVolumesFromImageTest-1894321723 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:13:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-39c5f14e-aa3a-430e-bf65-edeaaa7790eb tempest-CreateVolumesFromImageTest-1894321723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:13:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-39c5f14e-aa3a-430e-bf65-edeaaa7790eb tempest-CreateVolumesFromImageTest-1894321723 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:12 devstack quobyte-client[83193]: System call of process 100821 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 12:13:12 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fbfb4633-2d22-4856-94e9-959005cbf0cc tempest-CinderUnicodeTest-696598782 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7.c8a5b667-86c5-44cf-b7a8-303f018cb325" returned: 0 in 0.904s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:12 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-fbfb4633-2d22-4856-94e9-959005cbf0cc tempest-CinderUnicodeTest-696598782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 12:13:12 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1c08e3-1a68-4784-9331-c73a38436051]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:13:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fbfb4633-2d22-4856-94e9-959005cbf0cc tempest-CinderUnicodeTest-696598782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:13 devstack sudo[100815]: pam_unix(sudo:session): session closed for user root
Sep 18 12:13:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-39c5f14e-aa3a-430e-bf65-edeaaa7790eb tempest-CreateVolumesFromImageTest-1894321723 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.463s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:13 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-39c5f14e-aa3a-430e-bf65-edeaaa7790eb tempest-CreateVolumesFromImageTest-1894321723 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:13:13 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-00996998-a9e6-4e33-adda-7393c2a91d01 tempest-CreateVolumesFromImageTest-1894321723 None] Acquiring lock "cinder-a8ea8ceb-6be5-4a78-9d7d-b96072001a1b-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:13:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01cd37b3-d6c5-4e75-9b86-b4ded794c4f2_v2_xhmbqdevstack@QuobyteHD" returned: 0 in 3.344s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01cd37b3-d6c5-4e75-9b86-b4ded794c4f2_v2_xhmbqdevstack@QuobyteHD {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:13 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-39c5f14e-aa3a-430e-bf65-edeaaa7790eb tempest-CreateVolumesFromImageTest-1894321723 None] Deleted volume successfully.
Sep 18 12:13:13 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-00996998-a9e6-4e33-adda-7393c2a91d01 tempest-CreateVolumesFromImageTest-1894321723 None] Lock "cinder-a8ea8ceb-6be5-4a78-9d7d-b96072001a1b-delete_volume" acquired by "delete_volume" :: waited 0.550s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:13:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fbfb4633-2d22-4856-94e9-959005cbf0cc tempest-CinderUnicodeTest-696598782 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7" returned: 0 in 0.949s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:13 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fbfb4633-2d22-4856-94e9-959005cbf0cc tempest-CinderUnicodeTest-696598782 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7.c8a5b667-86c5-44cf-b7a8-303f018cb325 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:14 devstack sudo[100828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01cd37b3-d6c5-4e75-9b86-b4ded794c4f2_v2_xhmbqdevstack@QuobyteHD
Sep 18 12:13:14 devstack sudo[100828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 12:13:14 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-39c5f14e-aa3a-430e-bf65-edeaaa7790eb tempest-CreateVolumesFromImageTest-1894321723 None] Lock "cinder-65903d9e-5528-4ea2-94af-55293bb4586e-delete_volume" released by "delete_volume" :: held 5.802s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:13:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fbfb4633-2d22-4856-94e9-959005cbf0cc tempest-CinderUnicodeTest-696598782 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7.c8a5b667-86c5-44cf-b7a8-303f018cb325" returned: 0 in 0.467s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fbfb4633-2d22-4856-94e9-959005cbf0cc tempest-CinderUnicodeTest-696598782 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7.c8a5b667-86c5-44cf-b7a8-303f018cb325 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fbfb4633-2d22-4856-94e9-959005cbf0cc tempest-CinderUnicodeTest-696598782 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7.c8a5b667-86c5-44cf-b7a8-303f018cb325" returned: 0 in 0.485s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:14 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-00996998-a9e6-4e33-adda-7393c2a91d01 tempest-CreateVolumesFromImageTest-1894321723 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:13:14 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-00996998-a9e6-4e33-adda-7393c2a91d01 tempest-CreateVolumesFromImageTest-1894321723 None] Acquiring lock "cinder-quobyte-a8ea8ceb-6be5-4a78-9d7d-b96072001a1b" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:13:15 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-fbfb4633-2d22-4856-94e9-959005cbf0cc tempest-CinderUnicodeTest-696598782 None] Lock "cinder-quobyte-c8a5b667-86c5-44cf-b7a8-303f018cb325" released by "_delete_snapshot" :: held 3.162s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:13:15 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-fbfb4633-2d22-4856-94e9-959005cbf0cc tempest-CinderUnicodeTest-696598782 None] Lock "cinder-quobyte-a9579f49-8739-4c98-b33c-7ce9ba1dddb7" released by "delete_snapshot" :: held 3.201s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:13:15 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-00996998-a9e6-4e33-adda-7393c2a91d01 tempest-CreateVolumesFromImageTest-1894321723 None] Lock "cinder-quobyte-a8ea8ceb-6be5-4a78-9d7d-b96072001a1b" acquired by "delete_volume" :: waited 0.077s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:13:15 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5077e34-70c8-4646-a4a7-2a4ba2fb12ff]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:13:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-00996998-a9e6-4e33-adda-7393c2a91d01 tempest-CreateVolumesFromImageTest-1894321723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a8ea8ceb-6be5-4a78-9d7d-b96072001a1b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:15 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-fbfb4633-2d22-4856-94e9-959005cbf0cc tempest-CinderUnicodeTest-696598782 None] Created reservations ['6669cb76-d309-4e1a-ba28-4caf6cd25fb1', '93e4ad67-e4d1-429a-bf0a-1e08318e4a0b', 'e5752f5b-f723-4a92-a37f-72281fc90acc', 'f132a080-67fb-4a29-b1c1-e76d831b5a66'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:13:15 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-fbfb4633-2d22-4856-94e9-959005cbf0cc tempest-CinderUnicodeTest-696598782 None] Delete snapshot completed successfully.
Sep 18 12:13:16 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-fbfb4633-2d22-4856-94e9-959005cbf0cc tempest-CinderUnicodeTest-696598782 None] Lock "cinder-c8a5b667-86c5-44cf-b7a8-303f018cb325-delete_snapshot" released by "delete_snapshot" :: held 4.266s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:13:16 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-bec51361-4abe-4497-a026-b8085d0b0aeb tempest-CinderUnicodeTest-696598782 None] Acquiring lock "cinder-a9579f49-8739-4c98-b33c-7ce9ba1dddb7-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:13:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-00996998-a9e6-4e33-adda-7393c2a91d01 tempest-CreateVolumesFromImageTest-1894321723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a8ea8ceb-6be5-4a78-9d7d-b96072001a1b" returned: 0 in 1.024s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-00996998-a9e6-4e33-adda-7393c2a91d01 tempest-CreateVolumesFromImageTest-1894321723 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a8ea8ceb-6be5-4a78-9d7d-b96072001a1b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-00996998-a9e6-4e33-adda-7393c2a91d01 tempest-CreateVolumesFromImageTest-1894321723 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a8ea8ceb-6be5-4a78-9d7d-b96072001a1b" returned: 0 in 0.290s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:16 devstack sudo[100828]: pam_unix(sudo:session): session closed for user root
Sep 18 12:13:16 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-bec51361-4abe-4497-a026-b8085d0b0aeb tempest-CinderUnicodeTest-696598782 None] Lock "cinder-a9579f49-8739-4c98-b33c-7ce9ba1dddb7-delete_volume" acquired by "delete_volume" :: waited 0.411s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:13:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01cd37b3-d6c5-4e75-9b86-b4ded794c4f2_v2_xhmbqdevstack@QuobyteHD" returned: 1 in 3.164s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01cd37b3-d6c5-4e75-9b86-b4ded794c4f2_v2_xhmbqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 12:13:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:13:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:13:16 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3850cd9f-8e60-4811-8fa3-f53065c9c09b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='840d65997425438382eb277324a3f892',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:12:57Z,use_quota=True,user_id='20165a0bca354881bcac81b78f420b8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 12:13:16 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Creating volume 3850cd9f-8e60-4811-8fa3-f53065c9c09b {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 12:13:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:13:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:13:16 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:13:16 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:13:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:13:16 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 12:13:16 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 12:13:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-3850cd9f-8e60-4811-8fa3-f53065c9c09b 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:16 devstack quobyte-client[83193]: System call of process 100843 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 12:13:16 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=155, name=volume-3850cd9f-8e60-4811-8fa3-f53065c9c09b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:13:16 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-00996998-a9e6-4e33-adda-7393c2a91d01 tempest-CreateVolumesFromImageTest-1894321723 None] Lock "cinder-quobyte-a8ea8ceb-6be5-4a78-9d7d-b96072001a1b" released by "delete_volume" :: held 1.890s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:13:17 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-bec51361-4abe-4497-a026-b8085d0b0aeb tempest-CinderUnicodeTest-696598782 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:13:17 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-bec51361-4abe-4497-a026-b8085d0b0aeb tempest-CinderUnicodeTest-696598782 None] Acquiring lock "cinder-quobyte-a9579f49-8739-4c98-b33c-7ce9ba1dddb7" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:13:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-3850cd9f-8e60-4811-8fa3-f53065c9c09b 1073741824" returned: 0 in 0.505s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-3850cd9f-8e60-4811-8fa3-f53065c9c09b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:17 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-bec51361-4abe-4497-a026-b8085d0b0aeb tempest-CinderUnicodeTest-696598782 None] Lock "cinder-quobyte-a9579f49-8739-4c98-b33c-7ce9ba1dddb7" acquired by "delete_volume" :: waited 0.349s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:13:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-3850cd9f-8e60-4811-8fa3-f53065c9c09b" returned: 0 in 0.345s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:17 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] <== create_volume: return (870ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 12:13:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:13:17 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb51a43-ab0c-4e9b-81b5-6fb94c429262]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:13:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-bec51361-4abe-4497-a026-b8085d0b0aeb tempest-CinderUnicodeTest-696598782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:17 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-00996998-a9e6-4e33-adda-7393c2a91d01 tempest-CreateVolumesFromImageTest-1894321723 None] Created reservations ['8f484a4e-3686-452b-afe3-4f2951e9f3e6', '73168859-b626-4e60-8894-5b426bce8e5b', '5003f6b1-dbdc-4a3b-92c5-469b82433765', '33c4eaa7-bc5d-4c7d-905a-4ffb860d83b6'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:13:18 devstack cinder-volume[83176]: DEBUG cinder.volume.volume_utils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Attempting download of 01cd37b3-d6c5-4e75-9b86-b4ded794c4f2 ((None, [{'url': 'file:///opt/stack/data/glance/images/01cd37b3-d6c5-4e75-9b86-b4ded794c4f2', 'metadata': {}}])) to volume 3850cd9f-8e60-4811-8fa3-f53065c9c09b. {{(pid=83176) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 18 12:13:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-00996998-a9e6-4e33-adda-7393c2a91d01 tempest-CreateVolumesFromImageTest-1894321723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:13:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-00996998-a9e6-4e33-adda-7393c2a91d01 tempest-CreateVolumesFromImageTest-1894321723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:13:18 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-00996998-a9e6-4e33-adda-7393c2a91d01 tempest-CreateVolumesFromImageTest-1894321723 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:13:18 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-00996998-a9e6-4e33-adda-7393c2a91d01 tempest-CreateVolumesFromImageTest-1894321723 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:13:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-00996998-a9e6-4e33-adda-7393c2a91d01 tempest-CreateVolumesFromImageTest-1894321723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:13:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-00996998-a9e6-4e33-adda-7393c2a91d01 tempest-CreateVolumesFromImageTest-1894321723 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:18 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4eaaca-6261-445d-abc1-453bf4259e22]: (4, 'raw') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:13:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_01cd37b3-d6c5-4e75-9b86-b4ded794c4f2_mtm646k4 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-bec51361-4abe-4497-a026-b8085d0b0aeb tempest-CinderUnicodeTest-696598782 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7" returned: 0 in 0.930s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-bec51361-4abe-4497-a026-b8085d0b0aeb tempest-CinderUnicodeTest-696598782 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-00996998-a9e6-4e33-adda-7393c2a91d01 tempest-CreateVolumesFromImageTest-1894321723 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.437s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:18 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-00996998-a9e6-4e33-adda-7393c2a91d01 tempest-CreateVolumesFromImageTest-1894321723 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:13:18 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-00996998-a9e6-4e33-adda-7393c2a91d01 tempest-CreateVolumesFromImageTest-1894321723 None] Deleted volume successfully.
Sep 18 12:13:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-bec51361-4abe-4497-a026-b8085d0b0aeb tempest-CinderUnicodeTest-696598782 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a9579f49-8739-4c98-b33c-7ce9ba1dddb7" returned: 0 in 0.359s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:19 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-faf9a993-8ae2-44ad-a520-1f20dfcf82bb tempest-CreateVolumesFromImageTest-1894321723 None] Acquiring lock "cinder-361b9d35-5de4-404b-a0bb-142b7ba65a9e-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:13:19 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-bec51361-4abe-4497-a026-b8085d0b0aeb tempest-CinderUnicodeTest-696598782 None] Lock "cinder-quobyte-a9579f49-8739-4c98-b33c-7ce9ba1dddb7" released by "delete_volume" :: held 1.577s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:13:19 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-00996998-a9e6-4e33-adda-7393c2a91d01 tempest-CreateVolumesFromImageTest-1894321723 None] Lock "cinder-a8ea8ceb-6be5-4a78-9d7d-b96072001a1b-delete_volume" released by "delete_volume" :: held 5.210s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:13:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_01cd37b3-d6c5-4e75-9b86-b4ded794c4f2_mtm646k4" returned: 0 in 0.714s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_01cd37b3-d6c5-4e75-9b86-b4ded794c4f2_mtm646k4 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:19 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-faf9a993-8ae2-44ad-a520-1f20dfcf82bb tempest-CreateVolumesFromImageTest-1894321723 None] Lock "cinder-361b9d35-5de4-404b-a0bb-142b7ba65a9e-delete_volume" acquired by "delete_volume" :: waited 0.280s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:13:19 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-bec51361-4abe-4497-a026-b8085d0b0aeb tempest-CinderUnicodeTest-696598782 None] Created reservations ['4477ceac-cedc-47aa-b9d4-b7da4cdcdcb6', '3b5ec4e9-d760-4f4f-be7e-33a45300744c', '7329d7fe-0dce-44ec-9298-4f91ab537412', '3c5cf301-6a61-42fc-be20-ea02bc72e267'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:13:19 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-faf9a993-8ae2-44ad-a520-1f20dfcf82bb tempest-CreateVolumesFromImageTest-1894321723 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:13:19 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-faf9a993-8ae2-44ad-a520-1f20dfcf82bb tempest-CreateVolumesFromImageTest-1894321723 None] Acquiring lock "cinder-quobyte-361b9d35-5de4-404b-a0bb-142b7ba65a9e" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:13:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_01cd37b3-d6c5-4e75-9b86-b4ded794c4f2_mtm646k4" returned: 1 in 0.637s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_01cd37b3-d6c5-4e75-9b86-b4ded794c4f2_mtm646k4' failed. Not Retrying. {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 12:13:19 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[994a9318-5905-4af8-b410-d93b5120c409]: (4, 'raw') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:13:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01cd37b3-d6c5-4e75-9b86-b4ded794c4f2_v2_xhmbqdevstack@QuobyteHD {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:19 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-faf9a993-8ae2-44ad-a520-1f20dfcf82bb tempest-CreateVolumesFromImageTest-1894321723 None] Lock "cinder-quobyte-361b9d35-5de4-404b-a0bb-142b7ba65a9e" acquired by "delete_volume" :: waited 0.176s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:13:20 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[86572c05-49d8-4c6f-9aaf-ebed3ccfff78]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:13:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-faf9a993-8ae2-44ad-a520-1f20dfcf82bb tempest-CreateVolumesFromImageTest-1894321723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-361b9d35-5de4-404b-a0bb-142b7ba65a9e {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01cd37b3-d6c5-4e75-9b86-b4ded794c4f2_v2_xhmbqdevstack@QuobyteHD" returned: 0 in 0.762s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01cd37b3-d6c5-4e75-9b86-b4ded794c4f2_v2_xhmbqdevstack@QuobyteHD {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:20 devstack quobyte-client[83193]: System call of process 100858 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 12:13:20 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-5505ccca-12ec-4044-985b-02c22b44b483 tempest-CinderUnicodeTest-696598782 None] Acquiring lock "cinder-e2a17775-259c-4c62-8102-a341b3e42fbf-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:13:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-faf9a993-8ae2-44ad-a520-1f20dfcf82bb tempest-CreateVolumesFromImageTest-1894321723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-361b9d35-5de4-404b-a0bb-142b7ba65a9e" returned: 0 in 0.823s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-faf9a993-8ae2-44ad-a520-1f20dfcf82bb tempest-CreateVolumesFromImageTest-1894321723 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-361b9d35-5de4-404b-a0bb-142b7ba65a9e {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:21 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-5505ccca-12ec-4044-985b-02c22b44b483 tempest-CinderUnicodeTest-696598782 None] Lock "cinder-e2a17775-259c-4c62-8102-a341b3e42fbf-delete_volume" acquired by "delete_volume" :: waited 0.303s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:13:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-bec51361-4abe-4497-a026-b8085d0b0aeb tempest-CinderUnicodeTest-696598782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:13:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-bec51361-4abe-4497-a026-b8085d0b0aeb tempest-CinderUnicodeTest-696598782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:13:21 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-bec51361-4abe-4497-a026-b8085d0b0aeb tempest-CinderUnicodeTest-696598782 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:13:21 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-bec51361-4abe-4497-a026-b8085d0b0aeb tempest-CinderUnicodeTest-696598782 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:13:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-bec51361-4abe-4497-a026-b8085d0b0aeb tempest-CinderUnicodeTest-696598782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:13:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-bec51361-4abe-4497-a026-b8085d0b0aeb tempest-CinderUnicodeTest-696598782 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-faf9a993-8ae2-44ad-a520-1f20dfcf82bb tempest-CreateVolumesFromImageTest-1894321723 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-361b9d35-5de4-404b-a0bb-142b7ba65a9e" returned: 0 in 0.706s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01cd37b3-d6c5-4e75-9b86-b4ded794c4f2_v2_xhmbqdevstack@QuobyteHD" returned: 1 in 1.174s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01cd37b3-d6c5-4e75-9b86-b4ded794c4f2_v2_xhmbqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 12:13:21 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] 01cd37b3-d6c5-4e75-9b86-b4ded794c4f2 was raw, converting to raw {{(pid=83176) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 18 12:13:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_01cd37b3-d6c5-4e75-9b86-b4ded794c4f2_v2_xhmbqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-3850cd9f-8e60-4811-8fa3-f53065c9c09b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:22 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=155, name=volume-3850cd9f-8e60-4811-8fa3-f53065c9c09b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:13:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-bec51361-4abe-4497-a026-b8085d0b0aeb tempest-CinderUnicodeTest-696598782 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.682s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:22 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-5505ccca-12ec-4044-985b-02c22b44b483 tempest-CinderUnicodeTest-696598782 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:13:22 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-5505ccca-12ec-4044-985b-02c22b44b483 tempest-CinderUnicodeTest-696598782 None] Acquiring lock "cinder-quobyte-e2a17775-259c-4c62-8102-a341b3e42fbf" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:13:22 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-bec51361-4abe-4497-a026-b8085d0b0aeb tempest-CinderUnicodeTest-696598782 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:13:22 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-faf9a993-8ae2-44ad-a520-1f20dfcf82bb tempest-CreateVolumesFromImageTest-1894321723 None] Lock "cinder-quobyte-361b9d35-5de4-404b-a0bb-142b7ba65a9e" released by "delete_volume" :: held 2.349s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:13:22 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-bec51361-4abe-4497-a026-b8085d0b0aeb tempest-CinderUnicodeTest-696598782 None] Deleted volume successfully.
Sep 18 12:13:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_01cd37b3-d6c5-4e75-9b86-b4ded794c4f2_v2_xhmbqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-3850cd9f-8e60-4811-8fa3-f53065c9c09b" returned: 0 in 0.483s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:22 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_01cd37b3-d6c5-4e75-9b86-b4ded794c4f2_v2_xhmbqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-3850cd9f-8e60-4811-8fa3-f53065c9c09b {{(pid=83176) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 12:13:22 devstack cinder-volume[83176]: INFO cinder.image.image_utils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Converted 0.00 MB image at 0.00 MB/s
Sep 18 12:13:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-3850cd9f-8e60-4811-8fa3-f53065c9c09b 1G {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:22 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-5505ccca-12ec-4044-985b-02c22b44b483 tempest-CinderUnicodeTest-696598782 None] Lock "cinder-quobyte-e2a17775-259c-4c62-8102-a341b3e42fbf" acquired by "delete_volume" :: waited 0.445s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:13:22 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a087f2d-aa8a-4e46-99f3-a13be8daab6c]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:13:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5505ccca-12ec-4044-985b-02c22b44b483 tempest-CinderUnicodeTest-696598782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e2a17775-259c-4c62-8102-a341b3e42fbf {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:23 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-bec51361-4abe-4497-a026-b8085d0b0aeb tempest-CinderUnicodeTest-696598782 None] Lock "cinder-a9579f49-8739-4c98-b33c-7ce9ba1dddb7-delete_volume" released by "delete_volume" :: held 6.530s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:13:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-3850cd9f-8e60-4811-8fa3-f53065c9c09b 1G" returned: 0 in 0.746s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:23 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da27052-d815-4deb-bea8-ab284b354012]: (4, 'raw') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:13:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-3850cd9f-8e60-4811-8fa3-f53065c9c09b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:23 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-faf9a993-8ae2-44ad-a520-1f20dfcf82bb tempest-CreateVolumesFromImageTest-1894321723 None] Created reservations ['6d53a45a-b4bc-4f52-b381-32f2cee1e55b', '1835cb75-b7bf-4a32-b2aa-caf456a0f247', '647e25f0-c5f7-4f2c-aaf9-3190f0864d2f', 'efe31134-d35a-4821-82f9-da272dfc8b37'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:13:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5505ccca-12ec-4044-985b-02c22b44b483 tempest-CinderUnicodeTest-696598782 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e2a17775-259c-4c62-8102-a341b3e42fbf" returned: 0 in 0.876s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5505ccca-12ec-4044-985b-02c22b44b483 tempest-CinderUnicodeTest-696598782 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e2a17775-259c-4c62-8102-a341b3e42fbf {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5505ccca-12ec-4044-985b-02c22b44b483 tempest-CinderUnicodeTest-696598782 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-e2a17775-259c-4c62-8102-a341b3e42fbf" returned: 0 in 0.251s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-3850cd9f-8e60-4811-8fa3-f53065c9c09b" returned: 0 in 0.751s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-3850cd9f-8e60-4811-8fa3-f53065c9c09b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:24 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-5505ccca-12ec-4044-985b-02c22b44b483 tempest-CinderUnicodeTest-696598782 None] Lock "cinder-quobyte-e2a17775-259c-4c62-8102-a341b3e42fbf" released by "delete_volume" :: held 1.518s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:13:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-faf9a993-8ae2-44ad-a520-1f20dfcf82bb tempest-CreateVolumesFromImageTest-1894321723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:13:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-faf9a993-8ae2-44ad-a520-1f20dfcf82bb tempest-CreateVolumesFromImageTest-1894321723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:13:24 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-faf9a993-8ae2-44ad-a520-1f20dfcf82bb tempest-CreateVolumesFromImageTest-1894321723 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:13:24 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-faf9a993-8ae2-44ad-a520-1f20dfcf82bb tempest-CreateVolumesFromImageTest-1894321723 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:13:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-faf9a993-8ae2-44ad-a520-1f20dfcf82bb tempest-CreateVolumesFromImageTest-1894321723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:13:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-faf9a993-8ae2-44ad-a520-1f20dfcf82bb tempest-CreateVolumesFromImageTest-1894321723 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-faf9a993-8ae2-44ad-a520-1f20dfcf82bb tempest-CreateVolumesFromImageTest-1894321723 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.236s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-3850cd9f-8e60-4811-8fa3-f53065c9c09b" returned: 1 in 0.720s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-3850cd9f-8e60-4811-8fa3-f53065c9c09b' failed. Not Retrying. {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 12:13:24 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-faf9a993-8ae2-44ad-a520-1f20dfcf82bb tempest-CreateVolumesFromImageTest-1894321723 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:13:24 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-faf9a993-8ae2-44ad-a520-1f20dfcf82bb tempest-CreateVolumesFromImageTest-1894321723 None] Deleted volume successfully.
Sep 18 12:13:24 devstack cinder-volume[83176]: DEBUG cinder.volume.volume_utils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Downloaded image 01cd37b3-d6c5-4e75-9b86-b4ded794c4f2 ((None, [{'url': 'file:///opt/stack/data/glance/images/01cd37b3-d6c5-4e75-9b86-b4ded794c4f2', 'metadata': {}}])) to volume 3850cd9f-8e60-4811-8fa3-f53065c9c09b successfully. {{(pid=83176) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 18 12:13:24 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Temporary image 01cd37b3-d6c5-4e75-9b86-b4ded794c4f2 for user 20165a0bca354881bcac81b78f420b8f is deleted. {{(pid=83176) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 18 12:13:24 devstack cinder-volume[83176]: DEBUG cinder.volume.volume_utils [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Marking volume 3850cd9f-8e60-4811-8fa3-f53065c9c09b as bootable. {{(pid=83176) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 18 12:13:24 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-bb1334f2-fbc7-43ad-9e54-c40a61258ac0 tempest-CreateVolumesFromImageTest-1894321723 None] Acquiring lock "cinder-b7be7c7d-43ef-40b9-9e14-bb5b10e937b8-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:13:24 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-5505ccca-12ec-4044-985b-02c22b44b483 tempest-CinderUnicodeTest-696598782 None] Created reservations ['24357a58-50e5-4316-a21a-23dccebb7335', 'fb8186e5-9f14-48ad-b2d1-1185e4ae1d45', '9c2d1ee5-9dd3-4e64-b8c2-d4d2c4be8865', 'fb6ca574-99f3-4a40-a1b8-9805edb281b5'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:13:24 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Copying metadata from image 01cd37b3-d6c5-4e75-9b86-b4ded794c4f2 to 3850cd9f-8e60-4811-8fa3-f53065c9c09b. {{(pid=83176) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 18 12:13:24 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Creating volume glance metadata for volume 3850cd9f-8e60-4811-8fa3-f53065c9c09b backed by image 01cd37b3-d6c5-4e75-9b86-b4ded794c4f2 with: {'image_id': '01cd37b3-d6c5-4e75-9b86-b4ded794c4f2', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '5e2667c8b2b2fdced220008e85575f96', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=83176) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 18 12:13:24 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-faf9a993-8ae2-44ad-a520-1f20dfcf82bb tempest-CreateVolumesFromImageTest-1894321723 None] Lock "cinder-361b9d35-5de4-404b-a0bb-142b7ba65a9e-delete_volume" released by "delete_volume" :: held 5.695s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:13:25 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-bb1334f2-fbc7-43ad-9e54-c40a61258ac0 tempest-CreateVolumesFromImageTest-1894321723 None] Lock "cinder-b7be7c7d-43ef-40b9-9e14-bb5b10e937b8-delete_volume" acquired by "delete_volume" :: waited 0.116s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:13:25 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-bb1334f2-fbc7-43ad-9e54-c40a61258ac0 tempest-CreateVolumesFromImageTest-1894321723 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:13:25 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-bb1334f2-fbc7-43ad-9e54-c40a61258ac0 tempest-CreateVolumesFromImageTest-1894321723 None] Acquiring lock "cinder-quobyte-b7be7c7d-43ef-40b9-9e14-bb5b10e937b8" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:13:25 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fea3c0fc-53f4-46c9-97e0-9708d5f6bf83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3850cd9f-8e60-4811-8fa3-f53065c9c09b', 'volume_size': 1, 'image_id': '01cd37b3-d6c5-4e75-9b86-b4ded794c4f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/01cd37b3-d6c5-4e75-9b86-b4ded794c4f2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5e2667c8b2b2fdced220008e85575f96', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '840d65997425438382eb277324a3f892', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a759a0bb4ceca856abf7fc8b398cead8e81a6a49cca25e353d1dca48ec13fc0a6b8a1a2fe0fffcdf84abf35eb95ea935264c199523e8e25a4dbb1975c1bdfc71', 'id': '01cd37b3-d6c5-4e75-9b86-b4ded794c4f2', 'created_at': datetime.datetime(2025, 9, 18, 10, 12, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 10, 12, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/01cd37b3-d6c5-4e75-9b86-b4ded794c4f2/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6ada045750>}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:25 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91e5b068-c9ee-4845-ac2d-890e496c9d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:13:25 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-bb1334f2-fbc7-43ad-9e54-c40a61258ac0 tempest-CreateVolumesFromImageTest-1894321723 None] Lock "cinder-quobyte-b7be7c7d-43ef-40b9-9e14-bb5b10e937b8" acquired by "delete_volume" :: waited 0.078s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:13:25 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Volume volume-3850cd9f-8e60-4811-8fa3-f53065c9c09b (3850cd9f-8e60-4811-8fa3-f53065c9c09b): created successfully
Sep 18 12:13:25 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91e5b068-c9ee-4845-ac2d-890e496c9d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:25 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Flow 'volume_create_manager' (161b4c15-d522-455c-9218-673c20eab774) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:13:25 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b4b2f8-de5c-448f-9709-999a09dec2cb]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:13:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-bb1334f2-fbc7-43ad-9e54-c40a61258ac0 tempest-CreateVolumesFromImageTest-1894321723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b7be7c7d-43ef-40b9-9e14-bb5b10e937b8 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:25 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-f91d3e02-5810-4455-acf4-24e6306d254c tempest-VolumeImageDependencyTests-622452655 None] Created volume successfully.
Sep 18 12:13:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-5505ccca-12ec-4044-985b-02c22b44b483 tempest-CinderUnicodeTest-696598782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:13:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-5505ccca-12ec-4044-985b-02c22b44b483 tempest-CinderUnicodeTest-696598782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:13:25 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-5505ccca-12ec-4044-985b-02c22b44b483 tempest-CinderUnicodeTest-696598782 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:13:25 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-5505ccca-12ec-4044-985b-02c22b44b483 tempest-CinderUnicodeTest-696598782 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:13:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-5505ccca-12ec-4044-985b-02c22b44b483 tempest-CinderUnicodeTest-696598782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:13:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5505ccca-12ec-4044-985b-02c22b44b483 tempest-CinderUnicodeTest-696598782 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5505ccca-12ec-4044-985b-02c22b44b483 tempest-CinderUnicodeTest-696598782 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.133s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:25 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-5505ccca-12ec-4044-985b-02c22b44b483 tempest-CinderUnicodeTest-696598782 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:13:25 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-5505ccca-12ec-4044-985b-02c22b44b483 tempest-CinderUnicodeTest-696598782 None] Deleted volume successfully.
Sep 18 12:13:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-bb1334f2-fbc7-43ad-9e54-c40a61258ac0 tempest-CreateVolumesFromImageTest-1894321723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b7be7c7d-43ef-40b9-9e14-bb5b10e937b8" returned: 0 in 0.721s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-bb1334f2-fbc7-43ad-9e54-c40a61258ac0 tempest-CreateVolumesFromImageTest-1894321723 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b7be7c7d-43ef-40b9-9e14-bb5b10e937b8 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:26 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-c5659dae-be09-4b28-bfe3-38b7b8e51545 tempest-VolumeImageDependencyTests-622452655 None] Acquiring lock "cinder-3850cd9f-8e60-4811-8fa3-f53065c9c09b-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:13:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-bb1334f2-fbc7-43ad-9e54-c40a61258ac0 tempest-CreateVolumesFromImageTest-1894321723 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-b7be7c7d-43ef-40b9-9e14-bb5b10e937b8" returned: 0 in 0.324s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:26 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-5505ccca-12ec-4044-985b-02c22b44b483 tempest-CinderUnicodeTest-696598782 None] Lock "cinder-e2a17775-259c-4c62-8102-a341b3e42fbf-delete_volume" released by "delete_volume" :: held 5.092s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:13:26 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-bb1334f2-fbc7-43ad-9e54-c40a61258ac0 tempest-CreateVolumesFromImageTest-1894321723 None] Lock "cinder-quobyte-b7be7c7d-43ef-40b9-9e14-bb5b10e937b8" released by "delete_volume" :: held 1.139s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:13:26 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-c5659dae-be09-4b28-bfe3-38b7b8e51545 tempest-VolumeImageDependencyTests-622452655 None] Lock "cinder-3850cd9f-8e60-4811-8fa3-f53065c9c09b-delete_volume" acquired by "delete_volume" :: waited 0.207s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:13:26 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-bb1334f2-fbc7-43ad-9e54-c40a61258ac0 tempest-CreateVolumesFromImageTest-1894321723 None] Created reservations ['b8e6abb7-3708-4b01-8c21-fd8eca388fbe', '9f87d70a-b449-48ed-b05a-e5c707940c9c', '27665b7f-bf68-4df1-ad93-c36935906d5e', '289af982-c2da-4c16-adf0-45d2bb755ff9'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:13:26 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-c5659dae-be09-4b28-bfe3-38b7b8e51545 tempest-VolumeImageDependencyTests-622452655 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:13:26 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-c5659dae-be09-4b28-bfe3-38b7b8e51545 tempest-VolumeImageDependencyTests-622452655 None] Acquiring lock "cinder-quobyte-3850cd9f-8e60-4811-8fa3-f53065c9c09b" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:13:26 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-c5659dae-be09-4b28-bfe3-38b7b8e51545 tempest-VolumeImageDependencyTests-622452655 None] Lock "cinder-quobyte-3850cd9f-8e60-4811-8fa3-f53065c9c09b" acquired by "delete_volume" :: waited 0.032s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:13:26 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e58bdf-7438-4e33-9502-375a4bcea91a]: (4, 'raw') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:13:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c5659dae-be09-4b28-bfe3-38b7b8e51545 tempest-VolumeImageDependencyTests-622452655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-3850cd9f-8e60-4811-8fa3-f53065c9c09b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-bb1334f2-fbc7-43ad-9e54-c40a61258ac0 tempest-CreateVolumesFromImageTest-1894321723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:13:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-bb1334f2-fbc7-43ad-9e54-c40a61258ac0 tempest-CreateVolumesFromImageTest-1894321723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.032s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:13:27 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-bb1334f2-fbc7-43ad-9e54-c40a61258ac0 tempest-CreateVolumesFromImageTest-1894321723 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:13:27 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-bb1334f2-fbc7-43ad-9e54-c40a61258ac0 tempest-CreateVolumesFromImageTest-1894321723 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:13:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-bb1334f2-fbc7-43ad-9e54-c40a61258ac0 tempest-CreateVolumesFromImageTest-1894321723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:13:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-bb1334f2-fbc7-43ad-9e54-c40a61258ac0 tempest-CreateVolumesFromImageTest-1894321723 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-bb1334f2-fbc7-43ad-9e54-c40a61258ac0 tempest-CreateVolumesFromImageTest-1894321723 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.222s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:27 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-bb1334f2-fbc7-43ad-9e54-c40a61258ac0 tempest-CreateVolumesFromImageTest-1894321723 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:13:27 devstack quobyte-client[83193]: System call of process 100888 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 12:13:27 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-bb1334f2-fbc7-43ad-9e54-c40a61258ac0 tempest-CreateVolumesFromImageTest-1894321723 None] Deleted volume successfully.
Sep 18 12:13:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c5659dae-be09-4b28-bfe3-38b7b8e51545 tempest-VolumeImageDependencyTests-622452655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-3850cd9f-8e60-4811-8fa3-f53065c9c09b" returned: 0 in 0.959s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c5659dae-be09-4b28-bfe3-38b7b8e51545 tempest-VolumeImageDependencyTests-622452655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-3850cd9f-8e60-4811-8fa3-f53065c9c09b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:28 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-bb1334f2-fbc7-43ad-9e54-c40a61258ac0 tempest-CreateVolumesFromImageTest-1894321723 None] Lock "cinder-b7be7c7d-43ef-40b9-9e14-bb5b10e937b8-delete_volume" released by "delete_volume" :: held 2.980s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:13:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c5659dae-be09-4b28-bfe3-38b7b8e51545 tempest-VolumeImageDependencyTests-622452655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-3850cd9f-8e60-4811-8fa3-f53065c9c09b" returned: 1 in 0.671s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c5659dae-be09-4b28-bfe3-38b7b8e51545 tempest-VolumeImageDependencyTests-622452655 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-3850cd9f-8e60-4811-8fa3-f53065c9c09b' failed. Not Retrying. {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 12:13:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c5659dae-be09-4b28-bfe3-38b7b8e51545 tempest-VolumeImageDependencyTests-622452655 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-3850cd9f-8e60-4811-8fa3-f53065c9c09b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c5659dae-be09-4b28-bfe3-38b7b8e51545 tempest-VolumeImageDependencyTests-622452655 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-3850cd9f-8e60-4811-8fa3-f53065c9c09b" returned: 0 in 0.158s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:28 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-c5659dae-be09-4b28-bfe3-38b7b8e51545 tempest-VolumeImageDependencyTests-622452655 None] Lock "cinder-quobyte-3850cd9f-8e60-4811-8fa3-f53065c9c09b" released by "delete_volume" :: held 2.064s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:13:29 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-c5659dae-be09-4b28-bfe3-38b7b8e51545 tempest-VolumeImageDependencyTests-622452655 None] Created reservations ['800a9c74-7880-4045-a8da-401af3c0911e', 'bc18b615-ac2b-4420-b283-5fd3b53b08e5', '96ab8ac1-583c-4eb8-b1f0-0db4a138fb94', '17a0992b-b003-4038-8982-404e883e419c'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:13:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-c5659dae-be09-4b28-bfe3-38b7b8e51545 tempest-VolumeImageDependencyTests-622452655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:13:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-c5659dae-be09-4b28-bfe3-38b7b8e51545 tempest-VolumeImageDependencyTests-622452655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:13:29 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-c5659dae-be09-4b28-bfe3-38b7b8e51545 tempest-VolumeImageDependencyTests-622452655 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:13:29 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-c5659dae-be09-4b28-bfe3-38b7b8e51545 tempest-VolumeImageDependencyTests-622452655 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:13:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-c5659dae-be09-4b28-bfe3-38b7b8e51545 tempest-VolumeImageDependencyTests-622452655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:13:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c5659dae-be09-4b28-bfe3-38b7b8e51545 tempest-VolumeImageDependencyTests-622452655 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-c5659dae-be09-4b28-bfe3-38b7b8e51545 tempest-VolumeImageDependencyTests-622452655 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.136s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:29 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-c5659dae-be09-4b28-bfe3-38b7b8e51545 tempest-VolumeImageDependencyTests-622452655 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:13:29 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-c5659dae-be09-4b28-bfe3-38b7b8e51545 tempest-VolumeImageDependencyTests-622452655 None] Deleted volume successfully.
Sep 18 12:13:29 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-c5659dae-be09-4b28-bfe3-38b7b8e51545 tempest-VolumeImageDependencyTests-622452655 None] Lock "cinder-3850cd9f-8e60-4811-8fa3-f53065c9c09b-delete_volume" released by "delete_volume" :: held 3.474s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:13:32 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-5fb2c203-8d3f-4974-9fef-fe9d6e36fed0 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:13:32 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fb2c203-8d3f-4974-9fef-fe9d6e36fed0 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 12:13:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-5fb2c203-8d3f-4974-9fef-fe9d6e36fed0 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Flow 'volume_create_manager' (08565bf0-266e-4fbf-8ea8-c34c0b478236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:13:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-5fb2c203-8d3f-4974-9fef-fe9d6e36fed0 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a07c28ec-fd60-4ea1-b8f0-6e8b624f4776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:13:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-5fb2c203-8d3f-4974-9fef-fe9d6e36fed0 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a07c28ec-fd60-4ea1-b8f0-6e8b624f4776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1700388883',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=874e70ab-287d-419f-be4d-d6b6aee2d235,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef198c05c0db46389cd38e9e8045cf50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:13:32Z,use_quota=True,user_id='feaa527c57314ef089505c94c59ca033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-5fb2c203-8d3f-4974-9fef-fe9d6e36fed0 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c89fbd57-3de4-4958-b29b-0ad6333cde6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:13:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-5fb2c203-8d3f-4974-9fef-fe9d6e36fed0 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c89fbd57-3de4-4958-b29b-0ad6333cde6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-5fb2c203-8d3f-4974-9fef-fe9d6e36fed0 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fb75d01-a82e-4b2b-bf24-cdec0074ff95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:13:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-5fb2c203-8d3f-4974-9fef-fe9d6e36fed0 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fb75d01-a82e-4b2b-bf24-cdec0074ff95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '874e70ab-287d-419f-be4d-d6b6aee2d235', 'volume_name': 'volume-874e70ab-287d-419f-be4d-d6b6aee2d235', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-5fb2c203-8d3f-4974-9fef-fe9d6e36fed0 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d43d65d8-6858-4b94-a4ba-45114960ea4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:13:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-5fb2c203-8d3f-4974-9fef-fe9d6e36fed0 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d43d65d8-6858-4b94-a4ba-45114960ea4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:32 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-5fb2c203-8d3f-4974-9fef-fe9d6e36fed0 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baebd730-6386-4b91-9868-9c16917df3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:13:32 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-5fb2c203-8d3f-4974-9fef-fe9d6e36fed0 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Volume 874e70ab-287d-419f-be4d-d6b6aee2d235: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-874e70ab-287d-419f-be4d-d6b6aee2d235', 'volume_size': 1}
Sep 18 12:13:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-5fb2c203-8d3f-4974-9fef-fe9d6e36fed0 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:13:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-5fb2c203-8d3f-4974-9fef-fe9d6e36fed0 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:13:32 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-5fb2c203-8d3f-4974-9fef-fe9d6e36fed0 tempest-CreateVolumesFromSnapshotTest-1013112766 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1700388883',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=874e70ab-287d-419f-be4d-d6b6aee2d235,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef198c05c0db46389cd38e9e8045cf50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:13:32Z,use_quota=True,user_id='feaa527c57314ef089505c94c59ca033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 12:13:32 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-5fb2c203-8d3f-4974-9fef-fe9d6e36fed0 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Creating volume 874e70ab-287d-419f-be4d-d6b6aee2d235 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 12:13:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-5fb2c203-8d3f-4974-9fef-fe9d6e36fed0 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:13:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-5fb2c203-8d3f-4974-9fef-fe9d6e36fed0 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:13:32 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-5fb2c203-8d3f-4974-9fef-fe9d6e36fed0 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:13:32 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-5fb2c203-8d3f-4974-9fef-fe9d6e36fed0 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:13:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-5fb2c203-8d3f-4974-9fef-fe9d6e36fed0 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:13:32 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-5fb2c203-8d3f-4974-9fef-fe9d6e36fed0 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 12:13:32 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-5fb2c203-8d3f-4974-9fef-fe9d6e36fed0 tempest-CreateVolumesFromSnapshotTest-1013112766 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 12:13:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5fb2c203-8d3f-4974-9fef-fe9d6e36fed0 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-874e70ab-287d-419f-be4d-d6b6aee2d235 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:32 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=156, name=volume-874e70ab-287d-419f-be4d-d6b6aee2d235, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:13:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5fb2c203-8d3f-4974-9fef-fe9d6e36fed0 tempest-CreateVolumesFromSnapshotTest-1013112766 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-874e70ab-287d-419f-be4d-d6b6aee2d235 1073741824" returned: 0 in 0.496s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5fb2c203-8d3f-4974-9fef-fe9d6e36fed0 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-874e70ab-287d-419f-be4d-d6b6aee2d235 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-5fb2c203-8d3f-4974-9fef-fe9d6e36fed0 tempest-CreateVolumesFromSnapshotTest-1013112766 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-874e70ab-287d-419f-be4d-d6b6aee2d235" returned: 0 in 0.148s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:33 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-5fb2c203-8d3f-4974-9fef-fe9d6e36fed0 tempest-CreateVolumesFromSnapshotTest-1013112766 None] <== create_volume: return (724ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 12:13:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-5fb2c203-8d3f-4974-9fef-fe9d6e36fed0 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:13:33 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-5fb2c203-8d3f-4974-9fef-fe9d6e36fed0 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baebd730-6386-4b91-9868-9c16917df3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-874e70ab-287d-419f-be4d-d6b6aee2d235', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:33 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-5fb2c203-8d3f-4974-9fef-fe9d6e36fed0 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa2a9502-113c-4cb4-8000-ce0bee787cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:13:33 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-5fb2c203-8d3f-4974-9fef-fe9d6e36fed0 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Volume volume-874e70ab-287d-419f-be4d-d6b6aee2d235 (874e70ab-287d-419f-be4d-d6b6aee2d235): created successfully
Sep 18 12:13:33 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-5fb2c203-8d3f-4974-9fef-fe9d6e36fed0 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa2a9502-113c-4cb4-8000-ce0bee787cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:33 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-5fb2c203-8d3f-4974-9fef-fe9d6e36fed0 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Flow 'volume_create_manager' (08565bf0-266e-4fbf-8ea8-c34c0b478236) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:13:33 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-5fb2c203-8d3f-4974-9fef-fe9d6e36fed0 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Created volume successfully.
Sep 18 12:13:34 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-16b611ea-fb8e-46ce-8232-8de3f04821c7 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:13:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-16b611ea-fb8e-46ce-8232-8de3f04821c7 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:13:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-16b611ea-fb8e-46ce-8232-8de3f04821c7 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:13:34 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-16b611ea-fb8e-46ce-8232-8de3f04821c7 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Creating offline snapshot dfbf119f-5850-4d3e-b4c5-f1094d7ea92e of volume 874e70ab-287d-419f-be4d-d6b6aee2d235 {{(pid=83176) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 12:13:34 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6014add-a108-4b7f-b9cf-e6228e1f9948]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:13:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-16b611ea-fb8e-46ce-8232-8de3f04821c7 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-874e70ab-287d-419f-be4d-d6b6aee2d235 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-16b611ea-fb8e-46ce-8232-8de3f04821c7 tempest-CreateVolumesFromSnapshotTest-1013112766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-874e70ab-287d-419f-be4d-d6b6aee2d235" returned: 0 in 0.477s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-16b611ea-fb8e-46ce-8232-8de3f04821c7 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-874e70ab-287d-419f-be4d-d6b6aee2d235,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-874e70ab-287d-419f-be4d-d6b6aee2d235.dfbf119f-5850-4d3e-b4c5-f1094d7ea92e 1G {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:35 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=157, name=volume-874e70ab-287d-419f-be4d-d6b6aee2d235.dfbf119f-5850-4d3e-b4c5-f1094d7ea92e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:13:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-16b611ea-fb8e-46ce-8232-8de3f04821c7 tempest-CreateVolumesFromSnapshotTest-1013112766 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-874e70ab-287d-419f-be4d-d6b6aee2d235,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-874e70ab-287d-419f-be4d-d6b6aee2d235.dfbf119f-5850-4d3e-b4c5-f1094d7ea92e 1G" returned: 0 in 0.299s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-16b611ea-fb8e-46ce-8232-8de3f04821c7 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Running cmd (subprocess): qemu-img rebase -u -b volume-874e70ab-287d-419f-be4d-d6b6aee2d235 -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-874e70ab-287d-419f-be4d-d6b6aee2d235.dfbf119f-5850-4d3e-b4c5-f1094d7ea92e {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-16b611ea-fb8e-46ce-8232-8de3f04821c7 tempest-CreateVolumesFromSnapshotTest-1013112766 None] CMD "qemu-img rebase -u -b volume-874e70ab-287d-419f-be4d-d6b6aee2d235 -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-874e70ab-287d-419f-be4d-d6b6aee2d235.dfbf119f-5850-4d3e-b4c5-f1094d7ea92e" returned: 0 in 0.178s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:35 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-16b611ea-fb8e-46ce-8232-8de3f04821c7 tempest-CreateVolumesFromSnapshotTest-1013112766 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-874e70ab-287d-419f-be4d-d6b6aee2d235.dfbf119f-5850-4d3e-b4c5-f1094d7ea92e is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 12:13:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-16b611ea-fb8e-46ce-8232-8de3f04821c7 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-874e70ab-287d-419f-be4d-d6b6aee2d235.dfbf119f-5850-4d3e-b4c5-f1094d7ea92e {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-16b611ea-fb8e-46ce-8232-8de3f04821c7 tempest-CreateVolumesFromSnapshotTest-1013112766 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-874e70ab-287d-419f-be4d-d6b6aee2d235.dfbf119f-5850-4d3e-b4c5-f1094d7ea92e" returned: 0 in 0.121s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:36 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-16b611ea-fb8e-46ce-8232-8de3f04821c7 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Setting permissions: /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-874e70ab-287d-419f-be4d-d6b6aee2d235 -> 1000:1000 {{(pid=83176) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 12:13:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-16b611ea-fb8e-46ce-8232-8de3f04821c7 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-874e70ab-287d-419f-be4d-d6b6aee2d235 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-874e70ab-287d-419f-be4d-d6b6aee2d235.dfbf119f-5850-4d3e-b4c5-f1094d7ea92e {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-16b611ea-fb8e-46ce-8232-8de3f04821c7 tempest-CreateVolumesFromSnapshotTest-1013112766 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-874e70ab-287d-419f-be4d-d6b6aee2d235 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-874e70ab-287d-419f-be4d-d6b6aee2d235.dfbf119f-5850-4d3e-b4c5-f1094d7ea92e" returned: 0 in 0.107s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-16b611ea-fb8e-46ce-8232-8de3f04821c7 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-874e70ab-287d-419f-be4d-d6b6aee2d235.info {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-16b611ea-fb8e-46ce-8232-8de3f04821c7 tempest-CreateVolumesFromSnapshotTest-1013112766 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-874e70ab-287d-419f-be4d-d6b6aee2d235.info" returned: 0 in 0.111s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:36 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-16b611ea-fb8e-46ce-8232-8de3f04821c7 tempest-CreateVolumesFromSnapshotTest-1013112766 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-874e70ab-287d-419f-be4d-d6b6aee2d235.info is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 12:13:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-16b611ea-fb8e-46ce-8232-8de3f04821c7 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-874e70ab-287d-419f-be4d-d6b6aee2d235.info {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-16b611ea-fb8e-46ce-8232-8de3f04821c7 tempest-CreateVolumesFromSnapshotTest-1013112766 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-874e70ab-287d-419f-be4d-d6b6aee2d235.info" returned: 0 in 0.105s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-16b611ea-fb8e-46ce-8232-8de3f04821c7 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.802s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:13:36 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-16b611ea-fb8e-46ce-8232-8de3f04821c7 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Create snapshot completed successfully
Sep 18 12:13:38 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-895c2705-4e3a-4a08-8645-a42d6c0c31d6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:13:38 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-895c2705-4e3a-4a08-8645-a42d6c0c31d6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 12:13:38 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-895c2705-4e3a-4a08-8645-a42d6c0c31d6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Flow 'volume_create_manager' (a2cd3c89-ee2e-44f4-8641-8fdcc3f144f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:13:38 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-895c2705-4e3a-4a08-8645-a42d6c0c31d6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (482ebc5b-6869-426d-88de-a6ef5f660bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:13:38 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-895c2705-4e3a-4a08-8645-a42d6c0c31d6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (482ebc5b-6869-426d-88de-a6ef5f660bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:13:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1356773986',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e1ae3d3-a4b1-4a5d-bcac-d566697138d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef198c05c0db46389cd38e9e8045cf50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:13:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:13:38Z,use_quota=True,user_id='feaa527c57314ef089505c94c59ca033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:38 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-895c2705-4e3a-4a08-8645-a42d6c0c31d6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d31ecf7-7540-4d42-91b7-d73641e5f642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:13:38 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-895c2705-4e3a-4a08-8645-a42d6c0c31d6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d31ecf7-7540-4d42-91b7-d73641e5f642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:38 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-895c2705-4e3a-4a08-8645-a42d6c0c31d6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9f39df9-f470-4e3d-a8aa-852e32f533fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:13:38 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-895c2705-4e3a-4a08-8645-a42d6c0c31d6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9f39df9-f470-4e3d-a8aa-852e32f533fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e1ae3d3-a4b1-4a5d-bcac-d566697138d3', 'volume_name': 'volume-2e1ae3d3-a4b1-4a5d-bcac-d566697138d3', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:38 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-895c2705-4e3a-4a08-8645-a42d6c0c31d6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8771bc3-1bfa-4f5e-8d57-02d20f77dbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:13:38 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-895c2705-4e3a-4a08-8645-a42d6c0c31d6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8771bc3-1bfa-4f5e-8d57-02d20f77dbe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:38 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-895c2705-4e3a-4a08-8645-a42d6c0c31d6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c081bbd-0acb-433a-bc74-61c61f5f4180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:13:38 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-895c2705-4e3a-4a08-8645-a42d6c0c31d6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Volume 2e1ae3d3-a4b1-4a5d-bcac-d566697138d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e1ae3d3-a4b1-4a5d-bcac-d566697138d3', 'volume_size': 1}
Sep 18 12:13:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-895c2705-4e3a-4a08-8645-a42d6c0c31d6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:13:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-895c2705-4e3a-4a08-8645-a42d6c0c31d6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:13:38 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-895c2705-4e3a-4a08-8645-a42d6c0c31d6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:13:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1356773986',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e1ae3d3-a4b1-4a5d-bcac-d566697138d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef198c05c0db46389cd38e9e8045cf50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:13:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:13:38Z,use_quota=True,user_id='feaa527c57314ef089505c94c59ca033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 12:13:38 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-895c2705-4e3a-4a08-8645-a42d6c0c31d6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Creating volume 2e1ae3d3-a4b1-4a5d-bcac-d566697138d3 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 12:13:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-895c2705-4e3a-4a08-8645-a42d6c0c31d6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:13:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-895c2705-4e3a-4a08-8645-a42d6c0c31d6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:13:38 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-895c2705-4e3a-4a08-8645-a42d6c0c31d6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:13:38 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-895c2705-4e3a-4a08-8645-a42d6c0c31d6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:13:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-895c2705-4e3a-4a08-8645-a42d6c0c31d6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:13:38 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-895c2705-4e3a-4a08-8645-a42d6c0c31d6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 12:13:38 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-895c2705-4e3a-4a08-8645-a42d6c0c31d6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 12:13:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-895c2705-4e3a-4a08-8645-a42d6c0c31d6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2e1ae3d3-a4b1-4a5d-bcac-d566697138d3 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:38 devstack quobyte-client[83193]: System call of process 100916 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 12:13:38 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=159, name=volume-2e1ae3d3-a4b1-4a5d-bcac-d566697138d3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:13:39 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-895c2705-4e3a-4a08-8645-a42d6c0c31d6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2e1ae3d3-a4b1-4a5d-bcac-d566697138d3 1073741824" returned: 0 in 0.692s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:39 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-895c2705-4e3a-4a08-8645-a42d6c0c31d6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2e1ae3d3-a4b1-4a5d-bcac-d566697138d3 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:39 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-dbe103c0-803b-497b-83b6-8180822bb00a tempest-CreateVolumesFromSnapshotTest-1013112766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:13:39 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbe103c0-803b-497b-83b6-8180822bb00a tempest-CreateVolumesFromSnapshotTest-1013112766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 12:13:39 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-dbe103c0-803b-497b-83b6-8180822bb00a tempest-CreateVolumesFromSnapshotTest-1013112766 None] Flow 'volume_create_manager' (670a32af-0aab-4681-ac83-09e234743354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:13:39 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-dbe103c0-803b-497b-83b6-8180822bb00a tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8abdc7e-df55-4d79-b8b2-9103af722939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:13:40 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-dbe103c0-803b-497b-83b6-8180822bb00a tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8abdc7e-df55-4d79-b8b2-9103af722939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:13:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-441377505',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=471c26b5-429b-466c-ba87-1ff31f29ae36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef198c05c0db46389cd38e9e8045cf50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:13:39Z,use_quota=True,user_id='feaa527c57314ef089505c94c59ca033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:40 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-dbe103c0-803b-497b-83b6-8180822bb00a tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33a2d46a-7db0-4459-a288-6399b140015f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:13:40 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-dbe103c0-803b-497b-83b6-8180822bb00a tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33a2d46a-7db0-4459-a288-6399b140015f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:40 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-dbe103c0-803b-497b-83b6-8180822bb00a tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b684e9-c264-49f4-9f32-c16bb2b64de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:13:40 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-dbe103c0-803b-497b-83b6-8180822bb00a tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b684e9-c264-49f4-9f32-c16bb2b64de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '471c26b5-429b-466c-ba87-1ff31f29ae36', 'volume_name': 'volume-471c26b5-429b-466c-ba87-1ff31f29ae36', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:40 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-dbe103c0-803b-497b-83b6-8180822bb00a tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (674cf9dd-4ef0-47d2-9cbc-d55fcad5f147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:13:40 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-dbe103c0-803b-497b-83b6-8180822bb00a tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (674cf9dd-4ef0-47d2-9cbc-d55fcad5f147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:40 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-dbe103c0-803b-497b-83b6-8180822bb00a tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (061c6649-09c3-41f3-989e-0dd11f20f87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:13:40 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-dbe103c0-803b-497b-83b6-8180822bb00a tempest-CreateVolumesFromSnapshotTest-1013112766 None] Volume 471c26b5-429b-466c-ba87-1ff31f29ae36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-471c26b5-429b-466c-ba87-1ff31f29ae36', 'volume_size': 1}
Sep 18 12:13:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-dbe103c0-803b-497b-83b6-8180822bb00a tempest-CreateVolumesFromSnapshotTest-1013112766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:13:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-895c2705-4e3a-4a08-8645-a42d6c0c31d6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2e1ae3d3-a4b1-4a5d-bcac-d566697138d3" returned: 0 in 0.942s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:40 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-895c2705-4e3a-4a08-8645-a42d6c0c31d6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] <== create_volume: return (1740ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 12:13:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-895c2705-4e3a-4a08-8645-a42d6c0c31d6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.762s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:13:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-dbe103c0-803b-497b-83b6-8180822bb00a tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.321s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:13:40 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-dbe103c0-803b-497b-83b6-8180822bb00a tempest-CreateVolumesFromSnapshotTest-1013112766 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:13:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-441377505',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=471c26b5-429b-466c-ba87-1ff31f29ae36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef198c05c0db46389cd38e9e8045cf50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:13:39Z,use_quota=True,user_id='feaa527c57314ef089505c94c59ca033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 12:13:40 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-dbe103c0-803b-497b-83b6-8180822bb00a tempest-CreateVolumesFromSnapshotTest-1013112766 None] Creating volume 471c26b5-429b-466c-ba87-1ff31f29ae36 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 12:13:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-dbe103c0-803b-497b-83b6-8180822bb00a tempest-CreateVolumesFromSnapshotTest-1013112766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:13:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-dbe103c0-803b-497b-83b6-8180822bb00a tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:13:40 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-dbe103c0-803b-497b-83b6-8180822bb00a tempest-CreateVolumesFromSnapshotTest-1013112766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:13:40 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-dbe103c0-803b-497b-83b6-8180822bb00a tempest-CreateVolumesFromSnapshotTest-1013112766 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:13:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-dbe103c0-803b-497b-83b6-8180822bb00a tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:13:40 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-dbe103c0-803b-497b-83b6-8180822bb00a tempest-CreateVolumesFromSnapshotTest-1013112766 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 12:13:40 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-dbe103c0-803b-497b-83b6-8180822bb00a tempest-CreateVolumesFromSnapshotTest-1013112766 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 12:13:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-dbe103c0-803b-497b-83b6-8180822bb00a tempest-CreateVolumesFromSnapshotTest-1013112766 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-471c26b5-429b-466c-ba87-1ff31f29ae36 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:40 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=160, name=volume-471c26b5-429b-466c-ba87-1ff31f29ae36, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:13:41 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-8c8e40ca-df23-487c-95d4-10c61a8f1ec2 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:13:41 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c8e40ca-df23-487c-95d4-10c61a8f1ec2 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 12:13:41 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8c8e40ca-df23-487c-95d4-10c61a8f1ec2 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Flow 'volume_create_manager' (445ee1ff-2dfa-47be-8f7c-a9951883afd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:13:41 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8c8e40ca-df23-487c-95d4-10c61a8f1ec2 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cc4b800-a2a3-4ef8-bdf8-b2e1b0733712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:13:41 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-895c2705-4e3a-4a08-8645-a42d6c0c31d6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c081bbd-0acb-433a-bc74-61c61f5f4180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e1ae3d3-a4b1-4a5d-bcac-d566697138d3', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:41 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-895c2705-4e3a-4a08-8645-a42d6c0c31d6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0bd3d6f-1baf-41d5-ac87-42584d70da0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:13:41 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-bce4e1e6-6d06-4232-9724-6a1fe6d4cbf6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:13:41 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-bce4e1e6-6d06-4232-9724-6a1fe6d4cbf6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 12:13:41 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-bce4e1e6-6d06-4232-9724-6a1fe6d4cbf6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Flow 'volume_create_manager' (4cc13dac-e186-4276-afba-53b872fb4ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:13:41 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-bce4e1e6-6d06-4232-9724-6a1fe6d4cbf6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d2a800d-32c9-46ca-a941-6b078c236206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:13:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-dbe103c0-803b-497b-83b6-8180822bb00a tempest-CreateVolumesFromSnapshotTest-1013112766 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-471c26b5-429b-466c-ba87-1ff31f29ae36 1073741824" returned: 0 in 0.865s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:41 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-bce4e1e6-6d06-4232-9724-6a1fe6d4cbf6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d2a800d-32c9-46ca-a941-6b078c236206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-191559887',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7f92322-39ae-4800-bf90-6da46d38f3bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef198c05c0db46389cd38e9e8045cf50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:13:40Z,use_quota=True,user_id='feaa527c57314ef089505c94c59ca033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:41 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-bce4e1e6-6d06-4232-9724-6a1fe6d4cbf6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41a0ae2b-990d-43c8-a28a-9369b68ff1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:13:41 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-bce4e1e6-6d06-4232-9724-6a1fe6d4cbf6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41a0ae2b-990d-43c8-a28a-9369b68ff1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:41 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-bce4e1e6-6d06-4232-9724-6a1fe6d4cbf6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e56fd98b-add1-4a67-8ad4-c87d93082c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:13:41 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-bce4e1e6-6d06-4232-9724-6a1fe6d4cbf6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e56fd98b-add1-4a67-8ad4-c87d93082c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7f92322-39ae-4800-bf90-6da46d38f3bf', 'volume_name': 'volume-a7f92322-39ae-4800-bf90-6da46d38f3bf', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:41 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-bce4e1e6-6d06-4232-9724-6a1fe6d4cbf6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef64afc4-3845-45a9-ae8b-40fda1eb81f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:13:41 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-bce4e1e6-6d06-4232-9724-6a1fe6d4cbf6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef64afc4-3845-45a9-ae8b-40fda1eb81f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:41 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-bce4e1e6-6d06-4232-9724-6a1fe6d4cbf6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a44e4930-e60d-435a-8687-e844ee79ee6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:13:41 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-bce4e1e6-6d06-4232-9724-6a1fe6d4cbf6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Volume a7f92322-39ae-4800-bf90-6da46d38f3bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7f92322-39ae-4800-bf90-6da46d38f3bf', 'volume_size': 1}
Sep 18 12:13:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-bce4e1e6-6d06-4232-9724-6a1fe6d4cbf6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:13:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-dbe103c0-803b-497b-83b6-8180822bb00a tempest-CreateVolumesFromSnapshotTest-1013112766 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-471c26b5-429b-466c-ba87-1ff31f29ae36 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:41 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8c8e40ca-df23-487c-95d4-10c61a8f1ec2 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cc4b800-a2a3-4ef8-bdf8-b2e1b0733712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-884224827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d563de22-c718-4e5b-bc74-9e2e3021f990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef198c05c0db46389cd38e9e8045cf50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:13:40Z,use_quota=True,user_id='feaa527c57314ef089505c94c59ca033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:41 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8c8e40ca-df23-487c-95d4-10c61a8f1ec2 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0b53fbd-ea3a-48fa-8136-7bcf499b66f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:13:41 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8c8e40ca-df23-487c-95d4-10c61a8f1ec2 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0b53fbd-ea3a-48fa-8136-7bcf499b66f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:41 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8c8e40ca-df23-487c-95d4-10c61a8f1ec2 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8856eb90-b02a-466d-824e-6846868fe90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:13:41 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8c8e40ca-df23-487c-95d4-10c61a8f1ec2 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8856eb90-b02a-466d-824e-6846868fe90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd563de22-c718-4e5b-bc74-9e2e3021f990', 'volume_name': 'volume-d563de22-c718-4e5b-bc74-9e2e3021f990', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:41 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8c8e40ca-df23-487c-95d4-10c61a8f1ec2 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f82f0623-bdef-49b7-b74c-33b4ab2903db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:13:41 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8c8e40ca-df23-487c-95d4-10c61a8f1ec2 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f82f0623-bdef-49b7-b74c-33b4ab2903db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:41 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8c8e40ca-df23-487c-95d4-10c61a8f1ec2 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0808c020-47df-4886-b3c9-f1d4672640be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:13:41 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-8c8e40ca-df23-487c-95d4-10c61a8f1ec2 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Volume d563de22-c718-4e5b-bc74-9e2e3021f990: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d563de22-c718-4e5b-bc74-9e2e3021f990', 'volume_size': 1}
Sep 18 12:13:41 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-8c8e40ca-df23-487c-95d4-10c61a8f1ec2 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:13:41 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-895c2705-4e3a-4a08-8645-a42d6c0c31d6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Volume volume-2e1ae3d3-a4b1-4a5d-bcac-d566697138d3 (2e1ae3d3-a4b1-4a5d-bcac-d566697138d3): created successfully
Sep 18 12:13:41 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-895c2705-4e3a-4a08-8645-a42d6c0c31d6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0bd3d6f-1baf-41d5-ac87-42584d70da0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:41 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-895c2705-4e3a-4a08-8645-a42d6c0c31d6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Flow 'volume_create_manager' (a2cd3c89-ee2e-44f4-8641-8fdcc3f144f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:13:41 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-80eb5e02-406e-431a-a0fc-331960f0970b tempest-CreateVolumesFromSnapshotTest-1013112766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:13:41 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-80eb5e02-406e-431a-a0fc-331960f0970b tempest-CreateVolumesFromSnapshotTest-1013112766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 12:13:42 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-80eb5e02-406e-431a-a0fc-331960f0970b tempest-CreateVolumesFromSnapshotTest-1013112766 None] Flow 'volume_create_manager' (ebb65245-a297-45b0-b9eb-2a3370106ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:13:42 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-80eb5e02-406e-431a-a0fc-331960f0970b tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8682207-8fe4-419c-abca-38667355542c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:13:42 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-dbe103c0-803b-497b-83b6-8180822bb00a tempest-CreateVolumesFromSnapshotTest-1013112766 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-471c26b5-429b-466c-ba87-1ff31f29ae36" returned: 0 in 0.599s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:42 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-dbe103c0-803b-497b-83b6-8180822bb00a tempest-CreateVolumesFromSnapshotTest-1013112766 None] <== create_volume: return (1570ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 12:13:42 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-dbe103c0-803b-497b-83b6-8180822bb00a tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:13:42 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-bce4e1e6-6d06-4232-9724-6a1fe6d4cbf6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.672s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:13:42 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-bce4e1e6-6d06-4232-9724-6a1fe6d4cbf6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-191559887',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7f92322-39ae-4800-bf90-6da46d38f3bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef198c05c0db46389cd38e9e8045cf50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:13:40Z,use_quota=True,user_id='feaa527c57314ef089505c94c59ca033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 12:13:42 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-bce4e1e6-6d06-4232-9724-6a1fe6d4cbf6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Creating volume a7f92322-39ae-4800-bf90-6da46d38f3bf {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 12:13:42 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-bce4e1e6-6d06-4232-9724-6a1fe6d4cbf6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:13:42 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-bce4e1e6-6d06-4232-9724-6a1fe6d4cbf6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:13:42 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-bce4e1e6-6d06-4232-9724-6a1fe6d4cbf6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:13:42 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-bce4e1e6-6d06-4232-9724-6a1fe6d4cbf6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:13:42 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-bce4e1e6-6d06-4232-9724-6a1fe6d4cbf6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:13:42 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-bce4e1e6-6d06-4232-9724-6a1fe6d4cbf6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 12:13:42 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-bce4e1e6-6d06-4232-9724-6a1fe6d4cbf6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 12:13:42 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-bce4e1e6-6d06-4232-9724-6a1fe6d4cbf6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a7f92322-39ae-4800-bf90-6da46d38f3bf 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:42 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-895c2705-4e3a-4a08-8645-a42d6c0c31d6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Created volume successfully.
Sep 18 12:13:42 devstack quobyte-client[83193]: System call of process 100924 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 12:13:42 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=161, name=volume-a7f92322-39ae-4800-bf90-6da46d38f3bf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:13:42 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-dbe103c0-803b-497b-83b6-8180822bb00a tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (061c6649-09c3-41f3-989e-0dd11f20f87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-471c26b5-429b-466c-ba87-1ff31f29ae36', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:42 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-dbe103c0-803b-497b-83b6-8180822bb00a tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5caec639-5d5f-4d23-8c12-949c5b2528f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:13:42 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-80eb5e02-406e-431a-a0fc-331960f0970b tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8682207-8fe4-419c-abca-38667355542c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1507612699',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=158a3077-c083-4ab8-af5d-6c6a2636e9fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef198c05c0db46389cd38e9e8045cf50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:13:41Z,use_quota=True,user_id='feaa527c57314ef089505c94c59ca033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:42 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-80eb5e02-406e-431a-a0fc-331960f0970b tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9653fa69-7e78-449e-92b8-d4357c68d8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:13:42 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-80eb5e02-406e-431a-a0fc-331960f0970b tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9653fa69-7e78-449e-92b8-d4357c68d8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:42 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-80eb5e02-406e-431a-a0fc-331960f0970b tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c058633-7e5b-459c-913d-6844a41da85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:13:42 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-80eb5e02-406e-431a-a0fc-331960f0970b tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c058633-7e5b-459c-913d-6844a41da85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '158a3077-c083-4ab8-af5d-6c6a2636e9fb', 'volume_name': 'volume-158a3077-c083-4ab8-af5d-6c6a2636e9fb', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:42 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-80eb5e02-406e-431a-a0fc-331960f0970b tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b4e6499-03b0-4d0e-9d46-9dfbdb3ce88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:13:42 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-80eb5e02-406e-431a-a0fc-331960f0970b tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b4e6499-03b0-4d0e-9d46-9dfbdb3ce88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:42 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-80eb5e02-406e-431a-a0fc-331960f0970b tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33c46c93-e580-4738-9bcd-7352045d8fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:13:42 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-80eb5e02-406e-431a-a0fc-331960f0970b tempest-CreateVolumesFromSnapshotTest-1013112766 None] Volume 158a3077-c083-4ab8-af5d-6c6a2636e9fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-158a3077-c083-4ab8-af5d-6c6a2636e9fb', 'volume_size': 1}
Sep 18 12:13:42 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-80eb5e02-406e-431a-a0fc-331960f0970b tempest-CreateVolumesFromSnapshotTest-1013112766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:13:42 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-dbe103c0-803b-497b-83b6-8180822bb00a tempest-CreateVolumesFromSnapshotTest-1013112766 None] Volume volume-471c26b5-429b-466c-ba87-1ff31f29ae36 (471c26b5-429b-466c-ba87-1ff31f29ae36): created successfully
Sep 18 12:13:42 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-dbe103c0-803b-497b-83b6-8180822bb00a tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5caec639-5d5f-4d23-8c12-949c5b2528f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:42 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-dbe103c0-803b-497b-83b6-8180822bb00a tempest-CreateVolumesFromSnapshotTest-1013112766 None] Flow 'volume_create_manager' (670a32af-0aab-4681-ac83-09e234743354) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:13:42 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-bce4e1e6-6d06-4232-9724-6a1fe6d4cbf6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a7f92322-39ae-4800-bf90-6da46d38f3bf 1073741824" returned: 0 in 0.661s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:42 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-bce4e1e6-6d06-4232-9724-6a1fe6d4cbf6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a7f92322-39ae-4800-bf90-6da46d38f3bf {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:43 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-dbe103c0-803b-497b-83b6-8180822bb00a tempest-CreateVolumesFromSnapshotTest-1013112766 None] Created volume successfully.
Sep 18 12:13:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-bce4e1e6-6d06-4232-9724-6a1fe6d4cbf6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a7f92322-39ae-4800-bf90-6da46d38f3bf" returned: 0 in 0.300s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:43 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-bce4e1e6-6d06-4232-9724-6a1fe6d4cbf6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] <== create_volume: return (990ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 12:13:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-bce4e1e6-6d06-4232-9724-6a1fe6d4cbf6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:13:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-8c8e40ca-df23-487c-95d4-10c61a8f1ec2 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.457s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:13:43 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-8c8e40ca-df23-487c-95d4-10c61a8f1ec2 tempest-CreateVolumesFromSnapshotTest-1013112766 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-884224827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d563de22-c718-4e5b-bc74-9e2e3021f990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef198c05c0db46389cd38e9e8045cf50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:13:40Z,use_quota=True,user_id='feaa527c57314ef089505c94c59ca033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 12:13:43 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-8c8e40ca-df23-487c-95d4-10c61a8f1ec2 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Creating volume d563de22-c718-4e5b-bc74-9e2e3021f990 {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 12:13:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-8c8e40ca-df23-487c-95d4-10c61a8f1ec2 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:13:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-8c8e40ca-df23-487c-95d4-10c61a8f1ec2 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:13:43 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-8c8e40ca-df23-487c-95d4-10c61a8f1ec2 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:13:43 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-8c8e40ca-df23-487c-95d4-10c61a8f1ec2 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:13:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-8c8e40ca-df23-487c-95d4-10c61a8f1ec2 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:13:43 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-8c8e40ca-df23-487c-95d4-10c61a8f1ec2 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 12:13:43 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-8c8e40ca-df23-487c-95d4-10c61a8f1ec2 tempest-CreateVolumesFromSnapshotTest-1013112766 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 12:13:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8c8e40ca-df23-487c-95d4-10c61a8f1ec2 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d563de22-c718-4e5b-bc74-9e2e3021f990 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:43 devstack quobyte-client[83193]: System call of process 100930 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 12:13:43 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=162, name=volume-d563de22-c718-4e5b-bc74-9e2e3021f990, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:13:43 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-bce4e1e6-6d06-4232-9724-6a1fe6d4cbf6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a44e4930-e60d-435a-8687-e844ee79ee6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7f92322-39ae-4800-bf90-6da46d38f3bf', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:43 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-bce4e1e6-6d06-4232-9724-6a1fe6d4cbf6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de6b9eae-500e-4d71-b1fd-39dbeaee9eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:13:43 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-bce4e1e6-6d06-4232-9724-6a1fe6d4cbf6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Volume volume-a7f92322-39ae-4800-bf90-6da46d38f3bf (a7f92322-39ae-4800-bf90-6da46d38f3bf): created successfully
Sep 18 12:13:43 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-bce4e1e6-6d06-4232-9724-6a1fe6d4cbf6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de6b9eae-500e-4d71-b1fd-39dbeaee9eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:43 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-bce4e1e6-6d06-4232-9724-6a1fe6d4cbf6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Flow 'volume_create_manager' (4cc13dac-e186-4276-afba-53b872fb4ea4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:13:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8c8e40ca-df23-487c-95d4-10c61a8f1ec2 tempest-CreateVolumesFromSnapshotTest-1013112766 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d563de22-c718-4e5b-bc74-9e2e3021f990 1073741824" returned: 0 in 0.692s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:43 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8c8e40ca-df23-487c-95d4-10c61a8f1ec2 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d563de22-c718-4e5b-bc74-9e2e3021f990 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:44 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-bce4e1e6-6d06-4232-9724-6a1fe6d4cbf6 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Created volume successfully.
Sep 18 12:13:44 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:UPDATE=90,cinder:SELECT=60,cinder:DELETE=15,cinder:INSERT=19 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 12:13:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-8c8e40ca-df23-487c-95d4-10c61a8f1ec2 tempest-CreateVolumesFromSnapshotTest-1013112766 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d563de22-c718-4e5b-bc74-9e2e3021f990" returned: 0 in 0.282s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:44 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-8c8e40ca-df23-487c-95d4-10c61a8f1ec2 tempest-CreateVolumesFromSnapshotTest-1013112766 None] <== create_volume: return (1005ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 12:13:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-8c8e40ca-df23-487c-95d4-10c61a8f1ec2 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:13:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-80eb5e02-406e-431a-a0fc-331960f0970b tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.481s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:13:44 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-80eb5e02-406e-431a-a0fc-331960f0970b tempest-CreateVolumesFromSnapshotTest-1013112766 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1507612699',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=158a3077-c083-4ab8-af5d-6c6a2636e9fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef198c05c0db46389cd38e9e8045cf50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:13:41Z,use_quota=True,user_id='feaa527c57314ef089505c94c59ca033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 12:13:44 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-80eb5e02-406e-431a-a0fc-331960f0970b tempest-CreateVolumesFromSnapshotTest-1013112766 None] Creating volume 158a3077-c083-4ab8-af5d-6c6a2636e9fb {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 12:13:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-80eb5e02-406e-431a-a0fc-331960f0970b tempest-CreateVolumesFromSnapshotTest-1013112766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:13:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-80eb5e02-406e-431a-a0fc-331960f0970b tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:13:44 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-80eb5e02-406e-431a-a0fc-331960f0970b tempest-CreateVolumesFromSnapshotTest-1013112766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:13:44 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-80eb5e02-406e-431a-a0fc-331960f0970b tempest-CreateVolumesFromSnapshotTest-1013112766 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:13:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-80eb5e02-406e-431a-a0fc-331960f0970b tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:13:44 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-80eb5e02-406e-431a-a0fc-331960f0970b tempest-CreateVolumesFromSnapshotTest-1013112766 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 12:13:44 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-80eb5e02-406e-431a-a0fc-331960f0970b tempest-CreateVolumesFromSnapshotTest-1013112766 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 12:13:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-80eb5e02-406e-431a-a0fc-331960f0970b tempest-CreateVolumesFromSnapshotTest-1013112766 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-158a3077-c083-4ab8-af5d-6c6a2636e9fb 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:44 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:SELECT=74,cinder:UPDATE=107,cinder:DELETE=7,cinder:INSERT=26 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 12:13:44 devstack quobyte-client[83193]: System call of process 100934 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 12:13:44 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=163, name=volume-158a3077-c083-4ab8-af5d-6c6a2636e9fb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:13:44 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8c8e40ca-df23-487c-95d4-10c61a8f1ec2 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0808c020-47df-4886-b3c9-f1d4672640be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d563de22-c718-4e5b-bc74-9e2e3021f990', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:44 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8c8e40ca-df23-487c-95d4-10c61a8f1ec2 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3860ab7-2682-46bc-affb-bd9ed526d7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:13:44 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-8c8e40ca-df23-487c-95d4-10c61a8f1ec2 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Volume volume-d563de22-c718-4e5b-bc74-9e2e3021f990 (d563de22-c718-4e5b-bc74-9e2e3021f990): created successfully
Sep 18 12:13:44 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8c8e40ca-df23-487c-95d4-10c61a8f1ec2 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3860ab7-2682-46bc-affb-bd9ed526d7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:44 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-8c8e40ca-df23-487c-95d4-10c61a8f1ec2 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Flow 'volume_create_manager' (445ee1ff-2dfa-47be-8f7c-a9951883afd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:13:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-80eb5e02-406e-431a-a0fc-331960f0970b tempest-CreateVolumesFromSnapshotTest-1013112766 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-158a3077-c083-4ab8-af5d-6c6a2636e9fb 1073741824" returned: 0 in 0.559s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:44 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-80eb5e02-406e-431a-a0fc-331960f0970b tempest-CreateVolumesFromSnapshotTest-1013112766 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-158a3077-c083-4ab8-af5d-6c6a2636e9fb {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:45 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-8c8e40ca-df23-487c-95d4-10c61a8f1ec2 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Created volume successfully.
Sep 18 12:13:45 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-80eb5e02-406e-431a-a0fc-331960f0970b tempest-CreateVolumesFromSnapshotTest-1013112766 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-158a3077-c083-4ab8-af5d-6c6a2636e9fb" returned: 0 in 0.373s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:45 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-80eb5e02-406e-431a-a0fc-331960f0970b tempest-CreateVolumesFromSnapshotTest-1013112766 None] <== create_volume: return (962ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 12:13:45 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-80eb5e02-406e-431a-a0fc-331960f0970b tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:13:45 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-80eb5e02-406e-431a-a0fc-331960f0970b tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33c46c93-e580-4738-9bcd-7352045d8fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-158a3077-c083-4ab8-af5d-6c6a2636e9fb', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:45 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-80eb5e02-406e-431a-a0fc-331960f0970b tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b8bf494-8706-47b5-b694-5b25fb258164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:13:45 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-80eb5e02-406e-431a-a0fc-331960f0970b tempest-CreateVolumesFromSnapshotTest-1013112766 None] Volume volume-158a3077-c083-4ab8-af5d-6c6a2636e9fb (158a3077-c083-4ab8-af5d-6c6a2636e9fb): created successfully
Sep 18 12:13:45 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-80eb5e02-406e-431a-a0fc-331960f0970b tempest-CreateVolumesFromSnapshotTest-1013112766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b8bf494-8706-47b5-b694-5b25fb258164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:13:45 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-80eb5e02-406e-431a-a0fc-331960f0970b tempest-CreateVolumesFromSnapshotTest-1013112766 None] Flow 'volume_create_manager' (ebb65245-a297-45b0-b9eb-2a3370106ea8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:13:45 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-80eb5e02-406e-431a-a0fc-331960f0970b tempest-CreateVolumesFromSnapshotTest-1013112766 None] Created volume successfully.
Sep 18 12:13:45 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-45371023-363b-41b6-85fc-2acfc91bbbb5 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Acquiring lock "cinder-158a3077-c083-4ab8-af5d-6c6a2636e9fb-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:13:46 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-45371023-363b-41b6-85fc-2acfc91bbbb5 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "cinder-158a3077-c083-4ab8-af5d-6c6a2636e9fb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:13:46 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-45371023-363b-41b6-85fc-2acfc91bbbb5 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:13:46 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-45371023-363b-41b6-85fc-2acfc91bbbb5 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Acquiring lock "cinder-quobyte-158a3077-c083-4ab8-af5d-6c6a2636e9fb" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:13:46 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-45371023-363b-41b6-85fc-2acfc91bbbb5 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "cinder-quobyte-158a3077-c083-4ab8-af5d-6c6a2636e9fb" acquired by "delete_volume" :: waited 0.014s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:13:46 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf33ec65-a109-400d-90bd-798bd882902b]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:13:46 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-45371023-363b-41b6-85fc-2acfc91bbbb5 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-158a3077-c083-4ab8-af5d-6c6a2636e9fb {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:46 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-45371023-363b-41b6-85fc-2acfc91bbbb5 tempest-CreateVolumesFromSnapshotTest-1013112766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-158a3077-c083-4ab8-af5d-6c6a2636e9fb" returned: 0 in 0.509s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:46 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-45371023-363b-41b6-85fc-2acfc91bbbb5 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-158a3077-c083-4ab8-af5d-6c6a2636e9fb {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:46 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-45371023-363b-41b6-85fc-2acfc91bbbb5 tempest-CreateVolumesFromSnapshotTest-1013112766 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-158a3077-c083-4ab8-af5d-6c6a2636e9fb" returned: 0 in 0.100s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:46 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-45371023-363b-41b6-85fc-2acfc91bbbb5 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "cinder-quobyte-158a3077-c083-4ab8-af5d-6c6a2636e9fb" released by "delete_volume" :: held 0.788s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:13:47 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-45371023-363b-41b6-85fc-2acfc91bbbb5 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Created reservations ['e2d09c84-914b-4cd7-b796-c4eb20b8089b', '7e5ce92f-e925-4688-9b41-e03d4a690d38', '9c1855a7-9a2a-48d5-8530-82a4de529ded', '4084a805-a94b-40bc-96ca-c34fc2653595'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:13:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-45371023-363b-41b6-85fc-2acfc91bbbb5 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:13:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-45371023-363b-41b6-85fc-2acfc91bbbb5 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:13:47 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-45371023-363b-41b6-85fc-2acfc91bbbb5 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:13:47 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-45371023-363b-41b6-85fc-2acfc91bbbb5 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:13:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-45371023-363b-41b6-85fc-2acfc91bbbb5 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:13:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-45371023-363b-41b6-85fc-2acfc91bbbb5 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:47 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-45371023-363b-41b6-85fc-2acfc91bbbb5 tempest-CreateVolumesFromSnapshotTest-1013112766 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.103s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:47 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-45371023-363b-41b6-85fc-2acfc91bbbb5 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:13:47 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-45371023-363b-41b6-85fc-2acfc91bbbb5 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Deleted volume successfully.
Sep 18 12:13:47 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-45371023-363b-41b6-85fc-2acfc91bbbb5 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "cinder-158a3077-c083-4ab8-af5d-6c6a2636e9fb-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:13:48 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-04942564-6d04-442a-b974-d31b9e869002 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Acquiring lock "cinder-a7f92322-39ae-4800-bf90-6da46d38f3bf-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:13:48 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-04942564-6d04-442a-b974-d31b9e869002 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "cinder-a7f92322-39ae-4800-bf90-6da46d38f3bf-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:13:48 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-04942564-6d04-442a-b974-d31b9e869002 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:13:48 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-04942564-6d04-442a-b974-d31b9e869002 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Acquiring lock "cinder-quobyte-a7f92322-39ae-4800-bf90-6da46d38f3bf" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:13:48 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-04942564-6d04-442a-b974-d31b9e869002 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "cinder-quobyte-a7f92322-39ae-4800-bf90-6da46d38f3bf" acquired by "delete_volume" :: waited 0.012s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:13:48 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3c658f-ede9-40c7-9995-7e4d5ba0abeb]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:13:48 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-04942564-6d04-442a-b974-d31b9e869002 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a7f92322-39ae-4800-bf90-6da46d38f3bf {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-04942564-6d04-442a-b974-d31b9e869002 tempest-CreateVolumesFromSnapshotTest-1013112766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a7f92322-39ae-4800-bf90-6da46d38f3bf" returned: 0 in 0.435s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-04942564-6d04-442a-b974-d31b9e869002 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a7f92322-39ae-4800-bf90-6da46d38f3bf {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-04942564-6d04-442a-b974-d31b9e869002 tempest-CreateVolumesFromSnapshotTest-1013112766 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-a7f92322-39ae-4800-bf90-6da46d38f3bf" returned: 0 in 0.122s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:49 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-04942564-6d04-442a-b974-d31b9e869002 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "cinder-quobyte-a7f92322-39ae-4800-bf90-6da46d38f3bf" released by "delete_volume" :: held 0.728s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:13:49 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-04942564-6d04-442a-b974-d31b9e869002 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Created reservations ['c0a04fe1-ed93-4012-9a76-d57b4d870322', '61f42882-b2f6-4972-a641-c1403dd3ebe3', '3b3fc95b-34a4-4d3e-8c9a-71d4b51f193e', 'eefc0759-37fb-4170-8b6e-4cec1f80c9a9'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:13:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-04942564-6d04-442a-b974-d31b9e869002 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:13:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-04942564-6d04-442a-b974-d31b9e869002 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:13:49 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-04942564-6d04-442a-b974-d31b9e869002 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:13:49 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-04942564-6d04-442a-b974-d31b9e869002 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:13:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-04942564-6d04-442a-b974-d31b9e869002 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:13:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-04942564-6d04-442a-b974-d31b9e869002 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:49 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-04942564-6d04-442a-b974-d31b9e869002 tempest-CreateVolumesFromSnapshotTest-1013112766 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.107s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:49 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-04942564-6d04-442a-b974-d31b9e869002 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:13:50 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-04942564-6d04-442a-b974-d31b9e869002 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Deleted volume successfully.
Sep 18 12:13:50 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-04942564-6d04-442a-b974-d31b9e869002 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "cinder-a7f92322-39ae-4800-bf90-6da46d38f3bf-delete_volume" released by "delete_volume" :: held 1.867s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:13:50 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-fc780093-afd5-4b02-b765-45e8e1bd027d tempest-CreateVolumesFromSnapshotTest-1013112766 None] Acquiring lock "cinder-d563de22-c718-4e5b-bc74-9e2e3021f990-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:13:50 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-fc780093-afd5-4b02-b765-45e8e1bd027d tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "cinder-d563de22-c718-4e5b-bc74-9e2e3021f990-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:13:51 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-fc780093-afd5-4b02-b765-45e8e1bd027d tempest-CreateVolumesFromSnapshotTest-1013112766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:13:51 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-fc780093-afd5-4b02-b765-45e8e1bd027d tempest-CreateVolumesFromSnapshotTest-1013112766 None] Acquiring lock "cinder-quobyte-d563de22-c718-4e5b-bc74-9e2e3021f990" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:13:51 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-fc780093-afd5-4b02-b765-45e8e1bd027d tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "cinder-quobyte-d563de22-c718-4e5b-bc74-9e2e3021f990" acquired by "delete_volume" :: waited 0.017s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:13:51 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[00417cac-0bfb-49d1-9fb5-242a1f9d6944]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:13:51 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fc780093-afd5-4b02-b765-45e8e1bd027d tempest-CreateVolumesFromSnapshotTest-1013112766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d563de22-c718-4e5b-bc74-9e2e3021f990 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:51 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fc780093-afd5-4b02-b765-45e8e1bd027d tempest-CreateVolumesFromSnapshotTest-1013112766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d563de22-c718-4e5b-bc74-9e2e3021f990" returned: 0 in 0.452s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:51 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fc780093-afd5-4b02-b765-45e8e1bd027d tempest-CreateVolumesFromSnapshotTest-1013112766 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d563de22-c718-4e5b-bc74-9e2e3021f990 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:51 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fc780093-afd5-4b02-b765-45e8e1bd027d tempest-CreateVolumesFromSnapshotTest-1013112766 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-d563de22-c718-4e5b-bc74-9e2e3021f990" returned: 0 in 0.120s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:51 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-fc780093-afd5-4b02-b765-45e8e1bd027d tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "cinder-quobyte-d563de22-c718-4e5b-bc74-9e2e3021f990" released by "delete_volume" :: held 0.776s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:13:52 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-fc780093-afd5-4b02-b765-45e8e1bd027d tempest-CreateVolumesFromSnapshotTest-1013112766 None] Created reservations ['3bb5c7f8-71b0-430c-b5c3-6212e3806e4f', 'fafef72e-e177-485e-b1ea-b8cc9c39bef1', 'da3360de-aa5a-497b-a27b-c974c4151a0d', 'ce811455-04a7-4005-9027-928b755caaf0'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:13:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-fc780093-afd5-4b02-b765-45e8e1bd027d tempest-CreateVolumesFromSnapshotTest-1013112766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:13:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-fc780093-afd5-4b02-b765-45e8e1bd027d tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:13:52 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-fc780093-afd5-4b02-b765-45e8e1bd027d tempest-CreateVolumesFromSnapshotTest-1013112766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:13:52 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-fc780093-afd5-4b02-b765-45e8e1bd027d tempest-CreateVolumesFromSnapshotTest-1013112766 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:13:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-fc780093-afd5-4b02-b765-45e8e1bd027d tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:13:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fc780093-afd5-4b02-b765-45e8e1bd027d tempest-CreateVolumesFromSnapshotTest-1013112766 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:52 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-fc780093-afd5-4b02-b765-45e8e1bd027d tempest-CreateVolumesFromSnapshotTest-1013112766 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.131s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:52 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-fc780093-afd5-4b02-b765-45e8e1bd027d tempest-CreateVolumesFromSnapshotTest-1013112766 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:13:52 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-fc780093-afd5-4b02-b765-45e8e1bd027d tempest-CreateVolumesFromSnapshotTest-1013112766 None] Deleted volume successfully.
Sep 18 12:13:52 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-fc780093-afd5-4b02-b765-45e8e1bd027d tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "cinder-d563de22-c718-4e5b-bc74-9e2e3021f990-delete_volume" released by "delete_volume" :: held 2.005s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:13:53 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-97e4c4c8-c00b-4fb5-a40f-f8370353b535 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Acquiring lock "cinder-471c26b5-429b-466c-ba87-1ff31f29ae36-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:13:53 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-97e4c4c8-c00b-4fb5-a40f-f8370353b535 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "cinder-471c26b5-429b-466c-ba87-1ff31f29ae36-delete_volume" acquired by "delete_volume" :: waited 0.447s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:13:53 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-97e4c4c8-c00b-4fb5-a40f-f8370353b535 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:13:53 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-97e4c4c8-c00b-4fb5-a40f-f8370353b535 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Acquiring lock "cinder-quobyte-471c26b5-429b-466c-ba87-1ff31f29ae36" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:13:53 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-97e4c4c8-c00b-4fb5-a40f-f8370353b535 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "cinder-quobyte-471c26b5-429b-466c-ba87-1ff31f29ae36" acquired by "delete_volume" :: waited 0.011s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:13:53 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[99cee881-89d0-4d88-926d-f4954a49be8d]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:13:53 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-97e4c4c8-c00b-4fb5-a40f-f8370353b535 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-471c26b5-429b-466c-ba87-1ff31f29ae36 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-97e4c4c8-c00b-4fb5-a40f-f8370353b535 tempest-CreateVolumesFromSnapshotTest-1013112766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-471c26b5-429b-466c-ba87-1ff31f29ae36" returned: 0 in 0.526s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-97e4c4c8-c00b-4fb5-a40f-f8370353b535 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-471c26b5-429b-466c-ba87-1ff31f29ae36 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:54 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-97e4c4c8-c00b-4fb5-a40f-f8370353b535 tempest-CreateVolumesFromSnapshotTest-1013112766 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-471c26b5-429b-466c-ba87-1ff31f29ae36" returned: 0 in 0.147s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:54 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-97e4c4c8-c00b-4fb5-a40f-f8370353b535 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "cinder-quobyte-471c26b5-429b-466c-ba87-1ff31f29ae36" released by "delete_volume" :: held 0.877s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:13:55 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-97e4c4c8-c00b-4fb5-a40f-f8370353b535 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Created reservations ['59c9b644-180e-44d9-a932-e96de8c34cdd', 'c6696d68-d109-4c2b-a123-16dc68f30fe7', '81d8caa3-58c9-4ad1-b7e5-8a6f6cae5b78', '9ca605b2-a23f-4794-9fab-477c862c500d'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:13:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-97e4c4c8-c00b-4fb5-a40f-f8370353b535 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:13:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-97e4c4c8-c00b-4fb5-a40f-f8370353b535 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:13:55 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-97e4c4c8-c00b-4fb5-a40f-f8370353b535 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:13:55 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-97e4c4c8-c00b-4fb5-a40f-f8370353b535 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:13:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-97e4c4c8-c00b-4fb5-a40f-f8370353b535 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:13:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-97e4c4c8-c00b-4fb5-a40f-f8370353b535 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:55 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-97e4c4c8-c00b-4fb5-a40f-f8370353b535 tempest-CreateVolumesFromSnapshotTest-1013112766 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.104s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:55 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-97e4c4c8-c00b-4fb5-a40f-f8370353b535 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:13:55 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-97e4c4c8-c00b-4fb5-a40f-f8370353b535 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Deleted volume successfully.
Sep 18 12:13:55 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-97e4c4c8-c00b-4fb5-a40f-f8370353b535 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "cinder-471c26b5-429b-466c-ba87-1ff31f29ae36-delete_volume" released by "delete_volume" :: held 1.987s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:13:55 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-a45d41fe-ad15-4a88-8aa9-360ed469a561 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Acquiring lock "cinder-2e1ae3d3-a4b1-4a5d-bcac-d566697138d3-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:13:55 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-a45d41fe-ad15-4a88-8aa9-360ed469a561 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "cinder-2e1ae3d3-a4b1-4a5d-bcac-d566697138d3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:13:55 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-a45d41fe-ad15-4a88-8aa9-360ed469a561 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:13:55 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-a45d41fe-ad15-4a88-8aa9-360ed469a561 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Acquiring lock "cinder-quobyte-2e1ae3d3-a4b1-4a5d-bcac-d566697138d3" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:13:55 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-a45d41fe-ad15-4a88-8aa9-360ed469a561 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "cinder-quobyte-2e1ae3d3-a4b1-4a5d-bcac-d566697138d3" acquired by "delete_volume" :: waited 0.014s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:13:56 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc34ec6-bd68-40dd-b4b4-0af052fc9f52]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:13:56 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a45d41fe-ad15-4a88-8aa9-360ed469a561 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2e1ae3d3-a4b1-4a5d-bcac-d566697138d3 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:56 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a45d41fe-ad15-4a88-8aa9-360ed469a561 tempest-CreateVolumesFromSnapshotTest-1013112766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2e1ae3d3-a4b1-4a5d-bcac-d566697138d3" returned: 0 in 0.476s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:56 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a45d41fe-ad15-4a88-8aa9-360ed469a561 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2e1ae3d3-a4b1-4a5d-bcac-d566697138d3 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:56 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a45d41fe-ad15-4a88-8aa9-360ed469a561 tempest-CreateVolumesFromSnapshotTest-1013112766 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2e1ae3d3-a4b1-4a5d-bcac-d566697138d3" returned: 0 in 0.128s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:56 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-a45d41fe-ad15-4a88-8aa9-360ed469a561 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "cinder-quobyte-2e1ae3d3-a4b1-4a5d-bcac-d566697138d3" released by "delete_volume" :: held 0.772s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:13:57 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-a45d41fe-ad15-4a88-8aa9-360ed469a561 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Created reservations ['b301e8ad-8914-40bd-877a-7ad0f879e43f', '6f455b2c-a328-43ea-94d3-d76bbaeef92e', 'ae46c0fc-be14-46b5-abad-c3ca4f2f1e3d', '36c28dc6-7a2b-4554-8723-145ae1d29a06'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:13:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a45d41fe-ad15-4a88-8aa9-360ed469a561 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:13:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a45d41fe-ad15-4a88-8aa9-360ed469a561 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:13:57 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a45d41fe-ad15-4a88-8aa9-360ed469a561 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:13:57 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a45d41fe-ad15-4a88-8aa9-360ed469a561 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:13:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a45d41fe-ad15-4a88-8aa9-360ed469a561 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:13:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a45d41fe-ad15-4a88-8aa9-360ed469a561 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:57 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a45d41fe-ad15-4a88-8aa9-360ed469a561 tempest-CreateVolumesFromSnapshotTest-1013112766 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.118s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:57 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a45d41fe-ad15-4a88-8aa9-360ed469a561 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:13:57 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-a45d41fe-ad15-4a88-8aa9-360ed469a561 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Deleted volume successfully.
Sep 18 12:13:57 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-a45d41fe-ad15-4a88-8aa9-360ed469a561 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "cinder-2e1ae3d3-a4b1-4a5d-bcac-d566697138d3-delete_volume" released by "delete_volume" :: held 1.854s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:13:58 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-104d77a0-fb9e-4b64-9df1-b7f296f62019 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Acquiring lock "cinder-dfbf119f-5850-4d3e-b4c5-f1094d7ea92e-delete_snapshot" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:13:58 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-104d77a0-fb9e-4b64-9df1-b7f296f62019 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "cinder-dfbf119f-5850-4d3e-b4c5-f1094d7ea92e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:13:58 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-104d77a0-fb9e-4b64-9df1-b7f296f62019 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:13:58 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-104d77a0-fb9e-4b64-9df1-b7f296f62019 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Acquiring lock "cinder-quobyte-874e70ab-287d-419f-be4d-d6b6aee2d235" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:13:58 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-104d77a0-fb9e-4b64-9df1-b7f296f62019 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "cinder-quobyte-874e70ab-287d-419f-be4d-d6b6aee2d235" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:13:58 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-104d77a0-fb9e-4b64-9df1-b7f296f62019 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Acquiring lock "cinder-quobyte-dfbf119f-5850-4d3e-b4c5-f1094d7ea92e" by "_delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:13:58 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-104d77a0-fb9e-4b64-9df1-b7f296f62019 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "cinder-quobyte-dfbf119f-5850-4d3e-b4c5-f1094d7ea92e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:13:58 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-104d77a0-fb9e-4b64-9df1-b7f296f62019 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Deleting offline snapshot dfbf119f-5850-4d3e-b4c5-f1094d7ea92e of volume 874e70ab-287d-419f-be4d-d6b6aee2d235 {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 12:13:58 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-104d77a0-fb9e-4b64-9df1-b7f296f62019 tempest-CreateVolumesFromSnapshotTest-1013112766 None] snapshot_file for this snap is: volume-874e70ab-287d-419f-be4d-d6b6aee2d235.dfbf119f-5850-4d3e-b4c5-f1094d7ea92e {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 12:13:58 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97c2da6-4a47-430a-b490-ac677acc3db9]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:13:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-104d77a0-fb9e-4b64-9df1-b7f296f62019 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-874e70ab-287d-419f-be4d-d6b6aee2d235.dfbf119f-5850-4d3e-b4c5-f1094d7ea92e {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-104d77a0-fb9e-4b64-9df1-b7f296f62019 tempest-CreateVolumesFromSnapshotTest-1013112766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-874e70ab-287d-419f-be4d-d6b6aee2d235.dfbf119f-5850-4d3e-b4c5-f1094d7ea92e" returned: 0 in 0.447s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:58 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-104d77a0-fb9e-4b64-9df1-b7f296f62019 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-874e70ab-287d-419f-be4d-d6b6aee2d235(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 12:13:58 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b70ce8-a583-477e-a409-60a9552ef165]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:13:58 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-104d77a0-fb9e-4b64-9df1-b7f296f62019 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-874e70ab-287d-419f-be4d-d6b6aee2d235 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-104d77a0-fb9e-4b64-9df1-b7f296f62019 tempest-CreateVolumesFromSnapshotTest-1013112766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-874e70ab-287d-419f-be4d-d6b6aee2d235" returned: 0 in 0.699s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:13:59 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-104d77a0-fb9e-4b64-9df1-b7f296f62019 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-874e70ab-287d-419f-be4d-d6b6aee2d235.dfbf119f-5850-4d3e-b4c5-f1094d7ea92e {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:13:59 devstack quobyte-client[83193]: System call of process 100972 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 12:13:59 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-306cfa7e-32e8-405d-83d2-7b5b57e32df1 tempest-SnapshotDependencyTests-1254484672 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:13:59 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-306cfa7e-32e8-405d-83d2-7b5b57e32df1 tempest-SnapshotDependencyTests-1254484672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 12:13:59 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-306cfa7e-32e8-405d-83d2-7b5b57e32df1 tempest-SnapshotDependencyTests-1254484672 None] Flow 'volume_create_manager' (a3f8558f-936d-4246-8cee-50bfd88442d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:13:59 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-306cfa7e-32e8-405d-83d2-7b5b57e32df1 tempest-SnapshotDependencyTests-1254484672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (319fcaba-b04c-4dae-8a5d-eedb678ada0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:00 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-306cfa7e-32e8-405d-83d2-7b5b57e32df1 tempest-SnapshotDependencyTests-1254484672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (319fcaba-b04c-4dae-8a5d-eedb678ada0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2103875757',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38e3a05acacb4ad8b10f5bee98807cf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:13:59Z,use_quota=True,user_id='d755d279707d43f3ab6f54a8a0de3d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:00 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-306cfa7e-32e8-405d-83d2-7b5b57e32df1 tempest-SnapshotDependencyTests-1254484672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f02f092c-b6d2-4f8e-9b6c-805a24667bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:00 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-306cfa7e-32e8-405d-83d2-7b5b57e32df1 tempest-SnapshotDependencyTests-1254484672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f02f092c-b6d2-4f8e-9b6c-805a24667bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:00 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-306cfa7e-32e8-405d-83d2-7b5b57e32df1 tempest-SnapshotDependencyTests-1254484672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4e75820-3ab5-4f91-8197-303a8bacb35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:00 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-306cfa7e-32e8-405d-83d2-7b5b57e32df1 tempest-SnapshotDependencyTests-1254484672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4e75820-3ab5-4f91-8197-303a8bacb35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b', 'volume_name': 'volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:00 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-306cfa7e-32e8-405d-83d2-7b5b57e32df1 tempest-SnapshotDependencyTests-1254484672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3035c1e-d52e-4324-8d9b-b6f8842a7183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:00 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-306cfa7e-32e8-405d-83d2-7b5b57e32df1 tempest-SnapshotDependencyTests-1254484672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3035c1e-d52e-4324-8d9b-b6f8842a7183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:00 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-306cfa7e-32e8-405d-83d2-7b5b57e32df1 tempest-SnapshotDependencyTests-1254484672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c75bb46-7a80-4e37-bd7c-205e8d2e9f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:00 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-306cfa7e-32e8-405d-83d2-7b5b57e32df1 tempest-SnapshotDependencyTests-1254484672 None] Volume 8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b', 'volume_size': 1}
Sep 18 12:14:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-306cfa7e-32e8-405d-83d2-7b5b57e32df1 tempest-SnapshotDependencyTests-1254484672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:14:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-306cfa7e-32e8-405d-83d2-7b5b57e32df1 tempest-SnapshotDependencyTests-1254484672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:14:00 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-306cfa7e-32e8-405d-83d2-7b5b57e32df1 tempest-SnapshotDependencyTests-1254484672 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2103875757',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38e3a05acacb4ad8b10f5bee98807cf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:13:59Z,use_quota=True,user_id='d755d279707d43f3ab6f54a8a0de3d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 12:14:00 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-306cfa7e-32e8-405d-83d2-7b5b57e32df1 tempest-SnapshotDependencyTests-1254484672 None] Creating volume 8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 12:14:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-306cfa7e-32e8-405d-83d2-7b5b57e32df1 tempest-SnapshotDependencyTests-1254484672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:14:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-306cfa7e-32e8-405d-83d2-7b5b57e32df1 tempest-SnapshotDependencyTests-1254484672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:14:00 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-306cfa7e-32e8-405d-83d2-7b5b57e32df1 tempest-SnapshotDependencyTests-1254484672 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:14:00 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-306cfa7e-32e8-405d-83d2-7b5b57e32df1 tempest-SnapshotDependencyTests-1254484672 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:14:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-306cfa7e-32e8-405d-83d2-7b5b57e32df1 tempest-SnapshotDependencyTests-1254484672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:14:00 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-306cfa7e-32e8-405d-83d2-7b5b57e32df1 tempest-SnapshotDependencyTests-1254484672 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 12:14:00 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-306cfa7e-32e8-405d-83d2-7b5b57e32df1 tempest-SnapshotDependencyTests-1254484672 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 12:14:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-306cfa7e-32e8-405d-83d2-7b5b57e32df1 tempest-SnapshotDependencyTests-1254484672 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-104d77a0-fb9e-4b64-9df1-b7f296f62019 tempest-CreateVolumesFromSnapshotTest-1013112766 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-874e70ab-287d-419f-be4d-d6b6aee2d235.dfbf119f-5850-4d3e-b4c5-f1094d7ea92e" returned: 0 in 0.864s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:00 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=164, name=volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:14:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-104d77a0-fb9e-4b64-9df1-b7f296f62019 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-874e70ab-287d-419f-be4d-d6b6aee2d235.dfbf119f-5850-4d3e-b4c5-f1094d7ea92e {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-104d77a0-fb9e-4b64-9df1-b7f296f62019 tempest-CreateVolumesFromSnapshotTest-1013112766 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-874e70ab-287d-419f-be4d-d6b6aee2d235.dfbf119f-5850-4d3e-b4c5-f1094d7ea92e" returned: 0 in 0.242s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:00 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-104d77a0-fb9e-4b64-9df1-b7f296f62019 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "cinder-quobyte-dfbf119f-5850-4d3e-b4c5-f1094d7ea92e" released by "_delete_snapshot" :: held 2.614s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:14:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-306cfa7e-32e8-405d-83d2-7b5b57e32df1 tempest-SnapshotDependencyTests-1254484672 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b 1073741824" returned: 0 in 0.545s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:00 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-306cfa7e-32e8-405d-83d2-7b5b57e32df1 tempest-SnapshotDependencyTests-1254484672 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:01 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-104d77a0-fb9e-4b64-9df1-b7f296f62019 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "cinder-quobyte-874e70ab-287d-419f-be4d-d6b6aee2d235" released by "delete_snapshot" :: held 2.816s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:14:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-306cfa7e-32e8-405d-83d2-7b5b57e32df1 tempest-SnapshotDependencyTests-1254484672 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b" returned: 0 in 0.504s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:01 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-306cfa7e-32e8-405d-83d2-7b5b57e32df1 tempest-SnapshotDependencyTests-1254484672 None] <== create_volume: return (1075ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 12:14:01 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-306cfa7e-32e8-405d-83d2-7b5b57e32df1 tempest-SnapshotDependencyTests-1254484672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:14:01 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-306cfa7e-32e8-405d-83d2-7b5b57e32df1 tempest-SnapshotDependencyTests-1254484672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c75bb46-7a80-4e37-bd7c-205e8d2e9f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:01 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-306cfa7e-32e8-405d-83d2-7b5b57e32df1 tempest-SnapshotDependencyTests-1254484672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7829d84c-1596-4786-9b45-b8631946419c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:01 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-306cfa7e-32e8-405d-83d2-7b5b57e32df1 tempest-SnapshotDependencyTests-1254484672 None] Volume volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b (8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b): created successfully
Sep 18 12:14:01 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-306cfa7e-32e8-405d-83d2-7b5b57e32df1 tempest-SnapshotDependencyTests-1254484672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7829d84c-1596-4786-9b45-b8631946419c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:01 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-306cfa7e-32e8-405d-83d2-7b5b57e32df1 tempest-SnapshotDependencyTests-1254484672 None] Flow 'volume_create_manager' (a3f8558f-936d-4246-8cee-50bfd88442d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:14:01 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-104d77a0-fb9e-4b64-9df1-b7f296f62019 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Created reservations ['28a6ef99-e081-4a1b-aa8c-e30264575442', 'f468c1b7-1819-4da5-844e-64a27210ddfa', '976d4580-a3ee-43a5-bcb0-e7858e5cb1b3', 'e9a11cf3-55d4-41a9-bb13-e74d76cba9a8'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:14:01 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-306cfa7e-32e8-405d-83d2-7b5b57e32df1 tempest-SnapshotDependencyTests-1254484672 None] Created volume successfully.
Sep 18 12:14:01 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-104d77a0-fb9e-4b64-9df1-b7f296f62019 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Delete snapshot completed successfully.
Sep 18 12:14:01 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-104d77a0-fb9e-4b64-9df1-b7f296f62019 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "cinder-dfbf119f-5850-4d3e-b4c5-f1094d7ea92e-delete_snapshot" released by "delete_snapshot" :: held 3.542s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:14:02 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-834d8d8b-49f5-4935-9162-4970a60d5431 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Acquiring lock "cinder-874e70ab-287d-419f-be4d-d6b6aee2d235-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:14:02 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-834d8d8b-49f5-4935-9162-4970a60d5431 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "cinder-874e70ab-287d-419f-be4d-d6b6aee2d235-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:14:02 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-834d8d8b-49f5-4935-9162-4970a60d5431 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:14:02 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-834d8d8b-49f5-4935-9162-4970a60d5431 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Acquiring lock "cinder-quobyte-874e70ab-287d-419f-be4d-d6b6aee2d235" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:14:02 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-834d8d8b-49f5-4935-9162-4970a60d5431 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "cinder-quobyte-874e70ab-287d-419f-be4d-d6b6aee2d235" acquired by "delete_volume" :: waited 0.013s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:14:02 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3bc01b-0caa-45a1-8443-54bc784707ec]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:14:02 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-834d8d8b-49f5-4935-9162-4970a60d5431 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-874e70ab-287d-419f-be4d-d6b6aee2d235 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:03 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-834d8d8b-49f5-4935-9162-4970a60d5431 tempest-CreateVolumesFromSnapshotTest-1013112766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-874e70ab-287d-419f-be4d-d6b6aee2d235" returned: 0 in 0.520s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:03 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-834d8d8b-49f5-4935-9162-4970a60d5431 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-874e70ab-287d-419f-be4d-d6b6aee2d235 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:03 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-834d8d8b-49f5-4935-9162-4970a60d5431 tempest-CreateVolumesFromSnapshotTest-1013112766 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-874e70ab-287d-419f-be4d-d6b6aee2d235" returned: 0 in 0.367s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:03 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-6111c0de-fc84-415b-89ef-aac8e9e9b720 tempest-SnapshotDependencyTests-1254484672 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:14:03 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-6111c0de-fc84-415b-89ef-aac8e9e9b720 tempest-SnapshotDependencyTests-1254484672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:14:03 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-6111c0de-fc84-415b-89ef-aac8e9e9b720 tempest-SnapshotDependencyTests-1254484672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.008s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:14:03 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-834d8d8b-49f5-4935-9162-4970a60d5431 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "cinder-quobyte-874e70ab-287d-419f-be4d-d6b6aee2d235" released by "delete_volume" :: held 1.109s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:14:03 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-6111c0de-fc84-415b-89ef-aac8e9e9b720 tempest-SnapshotDependencyTests-1254484672 None] Creating offline snapshot f0a029e1-db43-4e4d-97b5-3c550e6885d2 of volume 8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b {{(pid=83176) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 12:14:03 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[95619885-5fa2-4fc7-9677-0e8bff90109a]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:14:03 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6111c0de-fc84-415b-89ef-aac8e9e9b720 tempest-SnapshotDependencyTests-1254484672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:04 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-834d8d8b-49f5-4935-9162-4970a60d5431 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Created reservations ['19617c9b-33a4-44fb-b1e1-6677c514660e', '1423e357-bbef-4326-b30b-652813b97ac2', '507e4d74-7a68-4e30-8d3d-25ec4694fa2f', 'ac71e0af-7e02-4634-b7e5-57e3060d2d39'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:14:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6111c0de-fc84-415b-89ef-aac8e9e9b720 tempest-SnapshotDependencyTests-1254484672 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b" returned: 0 in 0.573s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6111c0de-fc84-415b-89ef-aac8e9e9b720 tempest-SnapshotDependencyTests-1254484672 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b.f0a029e1-db43-4e4d-97b5-3c550e6885d2 1G {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-834d8d8b-49f5-4935-9162-4970a60d5431 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:14:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-834d8d8b-49f5-4935-9162-4970a60d5431 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.033s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:14:04 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-834d8d8b-49f5-4935-9162-4970a60d5431 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:14:04 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-834d8d8b-49f5-4935-9162-4970a60d5431 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:14:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-834d8d8b-49f5-4935-9162-4970a60d5431 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:14:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-834d8d8b-49f5-4935-9162-4970a60d5431 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:04 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=165, name=volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b.f0a029e1-db43-4e4d-97b5-3c550e6885d2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:14:04 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-834d8d8b-49f5-4935-9162-4970a60d5431 tempest-CreateVolumesFromSnapshotTest-1013112766 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.150s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:04 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-834d8d8b-49f5-4935-9162-4970a60d5431 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:14:04 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-834d8d8b-49f5-4935-9162-4970a60d5431 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Deleted volume successfully.
Sep 18 12:14:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6111c0de-fc84-415b-89ef-aac8e9e9b720 tempest-SnapshotDependencyTests-1254484672 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b.f0a029e1-db43-4e4d-97b5-3c550e6885d2 1G" returned: 0 in 0.613s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6111c0de-fc84-415b-89ef-aac8e9e9b720 tempest-SnapshotDependencyTests-1254484672 None] Running cmd (subprocess): qemu-img rebase -u -b volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b.f0a029e1-db43-4e4d-97b5-3c550e6885d2 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:05 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-834d8d8b-49f5-4935-9162-4970a60d5431 tempest-CreateVolumesFromSnapshotTest-1013112766 None] Lock "cinder-874e70ab-287d-419f-be4d-d6b6aee2d235-delete_volume" released by "delete_volume" :: held 2.759s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:14:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6111c0de-fc84-415b-89ef-aac8e9e9b720 tempest-SnapshotDependencyTests-1254484672 None] CMD "qemu-img rebase -u -b volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b -F qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b.f0a029e1-db43-4e4d-97b5-3c550e6885d2" returned: 0 in 0.285s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:05 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-6111c0de-fc84-415b-89ef-aac8e9e9b720 tempest-SnapshotDependencyTests-1254484672 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b.f0a029e1-db43-4e4d-97b5-3c550e6885d2 is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 12:14:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6111c0de-fc84-415b-89ef-aac8e9e9b720 tempest-SnapshotDependencyTests-1254484672 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b.f0a029e1-db43-4e4d-97b5-3c550e6885d2 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6111c0de-fc84-415b-89ef-aac8e9e9b720 tempest-SnapshotDependencyTests-1254484672 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b.f0a029e1-db43-4e4d-97b5-3c550e6885d2" returned: 0 in 0.109s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:05 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-6111c0de-fc84-415b-89ef-aac8e9e9b720 tempest-SnapshotDependencyTests-1254484672 None] Setting permissions: /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b -> 1000:1000 {{(pid=83176) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 12:14:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6111c0de-fc84-415b-89ef-aac8e9e9b720 tempest-SnapshotDependencyTests-1254484672 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b.f0a029e1-db43-4e4d-97b5-3c550e6885d2 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6111c0de-fc84-415b-89ef-aac8e9e9b720 tempest-SnapshotDependencyTests-1254484672 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b.f0a029e1-db43-4e4d-97b5-3c550e6885d2" returned: 0 in 0.112s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6111c0de-fc84-415b-89ef-aac8e9e9b720 tempest-SnapshotDependencyTests-1254484672 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b.info {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6111c0de-fc84-415b-89ef-aac8e9e9b720 tempest-SnapshotDependencyTests-1254484672 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b.info" returned: 0 in 0.116s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:05 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-6111c0de-fc84-415b-89ef-aac8e9e9b720 tempest-SnapshotDependencyTests-1254484672 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b.info is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 12:14:05 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6111c0de-fc84-415b-89ef-aac8e9e9b720 tempest-SnapshotDependencyTests-1254484672 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b.info {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:06 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-6111c0de-fc84-415b-89ef-aac8e9e9b720 tempest-SnapshotDependencyTests-1254484672 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b.info" returned: 0 in 0.102s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:06 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-6111c0de-fc84-415b-89ef-aac8e9e9b720 tempest-SnapshotDependencyTests-1254484672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.344s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:14:06 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-6111c0de-fc84-415b-89ef-aac8e9e9b720 tempest-SnapshotDependencyTests-1254484672 None] Create snapshot completed successfully
Sep 18 12:14:08 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:14:08 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 12:14:08 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Flow 'volume_create_manager' (909fa6fe-b35d-4be9-a6c5-a1f658dff09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:14:08 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (883e14e4-692d-4a6e-9047-5300ba313103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:08 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (883e14e4-692d-4a6e-9047-5300ba313103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2eb09f8-ca37-43fe-b692-5250d131c0b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38e3a05acacb4ad8b10f5bee98807cf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f0a029e1-db43-4e4d-97b5-3c550e6885d2,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:14:08Z,use_quota=True,user_id='d755d279707d43f3ab6f54a8a0de3d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:08 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56bc52df-9448-4e4a-ba5f-92d201bf9e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:08 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56bc52df-9448-4e4a-ba5f-92d201bf9e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:08 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a348478f-c3db-4d3a-a436-a3e36ca4a2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:08 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a348478f-c3db-4d3a-a436-a3e36ca4a2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f2eb09f8-ca37-43fe-b692-5250d131c0b5', 'volume_name': 'volume-f2eb09f8-ca37-43fe-b692-5250d131c0b5', 'volume_size': 1, 'snapshot_id': 'f0a029e1-db43-4e4d-97b5-3c550e6885d2'}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:08 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ae7b5bf-11cc-400a-901f-5eb6a5f2a696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:08 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ae7b5bf-11cc-400a-901f-5eb6a5f2a696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:08 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5fb1865-55f9-44c4-a4cb-571842d2a206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:08 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Volume f2eb09f8-ca37-43fe-b692-5250d131c0b5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f2eb09f8-ca37-43fe-b692-5250d131c0b5', 'volume_size': 1, 'snapshot_id': 'f0a029e1-db43-4e4d-97b5-3c550e6885d2'}
Sep 18 12:14:08 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-f5f7a04d-8501-4bd7-b739-d22be7d0a20d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:14:08 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5f7a04d-8501-4bd7-b739-d22be7d0a20d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 12:14:08 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f5f7a04d-8501-4bd7-b739-d22be7d0a20d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Flow 'volume_create_manager' (18e7a483-1e10-4fdf-bde8-7e3dd913495d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:14:08 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f5f7a04d-8501-4bd7-b739-d22be7d0a20d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57b5cb9e-92bd-4299-829a-c37a4222ffe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:14:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:14:08 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Acquiring lock "cinder-quobyte-f0a029e1-db43-4e4d-97b5-3c550e6885d2-f2eb09f8-ca37-43fe-b692-5250d131c0b5" by "_create_volume_from_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:14:08 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f5f7a04d-8501-4bd7-b739-d22be7d0a20d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57b5cb9e-92bd-4299-829a-c37a4222ffe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1214633213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fa76113-535b-454e-b05b-22812260cdfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='520f2259f04849498d55ecfd28a09cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:14:08Z,use_quota=True,user_id='2e34fa458ab64f3390ec19204f3341e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:08 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f5f7a04d-8501-4bd7-b739-d22be7d0a20d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eef197f2-436f-4c89-8fe9-e8692a6d570b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:08 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f5f7a04d-8501-4bd7-b739-d22be7d0a20d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eef197f2-436f-4c89-8fe9-e8692a6d570b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:08 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f5f7a04d-8501-4bd7-b739-d22be7d0a20d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85a634cc-1a80-4483-af25-4b7ad333a347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:08 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f5f7a04d-8501-4bd7-b739-d22be7d0a20d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85a634cc-1a80-4483-af25-4b7ad333a347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fa76113-535b-454e-b05b-22812260cdfb', 'volume_name': 'volume-2fa76113-535b-454e-b05b-22812260cdfb', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:08 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f5f7a04d-8501-4bd7-b739-d22be7d0a20d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82266419-b8d5-422f-8572-a5a97981bf0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:08 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f5f7a04d-8501-4bd7-b739-d22be7d0a20d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82266419-b8d5-422f-8572-a5a97981bf0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:08 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f5f7a04d-8501-4bd7-b739-d22be7d0a20d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc520a7d-54c7-401d-a985-1ebfec3ad550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:08 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-f5f7a04d-8501-4bd7-b739-d22be7d0a20d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Volume 2fa76113-535b-454e-b05b-22812260cdfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fa76113-535b-454e-b05b-22812260cdfb', 'volume_size': 1}
Sep 18 12:14:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f5f7a04d-8501-4bd7-b739-d22be7d0a20d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:14:08 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Lock "cinder-quobyte-f0a029e1-db43-4e4d-97b5-3c550e6885d2-f2eb09f8-ca37-43fe-b692-5250d131c0b5" acquired by "_create_volume_from_snapshot" :: waited 0.045s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:14:08 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Creating volume f2eb09f8-ca37-43fe-b692-5250d131c0b5 from snapshot f0a029e1-db43-4e4d-97b5-3c550e6885d2 {{(pid=83176) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 18 12:14:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:14:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:14:08 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:14:08 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:14:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:14:08 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 12:14:08 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Acquiring lock "cinder-quobyte-f2eb09f8-ca37-43fe-b692-5250d131c0b5" by "_copy_volume_from_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:14:08 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Lock "cinder-quobyte-f2eb09f8-ca37-43fe-b692-5250d131c0b5" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:14:08 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] snapshot: f0a029e1-db43-4e4d-97b5-3c550e6885d2, volume: f2eb09f8-ca37-43fe-b692-5250d131c0b5,  {{(pid=83176) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 18 12:14:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:14:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:14:08 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:14:08 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:14:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:14:08 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[569789d0-76fa-4d34-8f32-f35d0111e14a]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:14:08 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b.f0a029e1-db43-4e4d-97b5-3c550e6885d2 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b.f0a029e1-db43-4e4d-97b5-3c550e6885d2" returned: 0 in 0.372s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:09 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 12:14:09 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] will copy from snapshot at /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b {{(pid=83176) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 18 12:14:09 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Creating direct copy from snapshot {{(pid=83176) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 18 12:14:09 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ca8370-73ba-4904-999a-d0b72e5d8237]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:14:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b" returned: 0 in 0.403s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:09 devstack cinder-volume[83176]: DEBUG cinder.utils [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f2eb09f8-ca37-43fe-b692-5250d131c0b5 not found in is_blk_device check {{(pid=83176) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 18 12:14:09 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f2eb09f8-ca37-43fe-b692-5250d131c0b5 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:09 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=167, name=volume-f2eb09f8-ca37-43fe-b692-5250d131c0b5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:14:14 devstack cinder-volume[83176]: DEBUG oslo_service.periodic_task [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 12:14:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:14:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:14:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:14:14 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:14:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:14:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f2eb09f8-ca37-43fe-b692-5250d131c0b5" returned: 0 in 4.976s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:14 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[861fed89-aa30-4c22-89dd-169b6075fd78]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:14:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:14 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.254s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:14 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-a9451ade-c592-46b3-b469-54664ca08af3 None None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:14:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b" returned: 0 in 0.568s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:15 devstack cinder-volume[83176]: DEBUG cinder.image.image_utils [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Image conversion details: src /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b, size 1024.00 MB, duration 5.01 sec, destination /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f2eb09f8-ca37-43fe-b692-5250d131c0b5 {{(pid=83176) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 12:14:15 devstack cinder-volume[83176]: INFO cinder.image.image_utils [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Converted 1024.00 MB image at 204.31 MB/s
Sep 18 12:14:15 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] File path /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f2eb09f8-ca37-43fe-b692-5250d131c0b5 is being set with permissions: 660 {{(pid=83176) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 12:14:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f2eb09f8-ca37-43fe-b692-5250d131c0b5 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f2eb09f8-ca37-43fe-b692-5250d131c0b5" returned: 0 in 0.095s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:15 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Lock "cinder-quobyte-f2eb09f8-ca37-43fe-b692-5250d131c0b5" released by "_copy_volume_from_snapshot" :: held 6.833s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:14:15 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Lock "cinder-quobyte-f0a029e1-db43-4e4d-97b5-3c550e6885d2-f2eb09f8-ca37-43fe-b692-5250d131c0b5" released by "_create_volume_from_snapshot" :: held 6.890s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:14:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.941s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:14:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f5f7a04d-8501-4bd7-b739-d22be7d0a20d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.012s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:14:15 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f5f7a04d-8501-4bd7-b739-d22be7d0a20d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1214633213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fa76113-535b-454e-b05b-22812260cdfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='520f2259f04849498d55ecfd28a09cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:14:08Z,use_quota=True,user_id='2e34fa458ab64f3390ec19204f3341e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 12:14:15 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-f5f7a04d-8501-4bd7-b739-d22be7d0a20d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Creating volume 2fa76113-535b-454e-b05b-22812260cdfb {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 12:14:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f5f7a04d-8501-4bd7-b739-d22be7d0a20d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:14:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f5f7a04d-8501-4bd7-b739-d22be7d0a20d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:14:15 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f5f7a04d-8501-4bd7-b739-d22be7d0a20d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:14:15 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f5f7a04d-8501-4bd7-b739-d22be7d0a20d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:14:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f5f7a04d-8501-4bd7-b739-d22be7d0a20d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:14:15 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f5f7a04d-8501-4bd7-b739-d22be7d0a20d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 12:14:15 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-f5f7a04d-8501-4bd7-b739-d22be7d0a20d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 12:14:15 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f5f7a04d-8501-4bd7-b739-d22be7d0a20d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2fa76113-535b-454e-b05b-22812260cdfb 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:15 devstack quobyte-client[83193]: System call of process 101059 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 12:14:15 devstack quobyte-client[83193]: System call of process 101059 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 12:14:15 devstack quobyte-client[83193]: System call of process 101059 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 12:14:15 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=168, name=volume-2fa76113-535b-454e-b05b-22812260cdfb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:14:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f5f7a04d-8501-4bd7-b739-d22be7d0a20d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2fa76113-535b-454e-b05b-22812260cdfb 1073741824" returned: 0 in 0.400s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f5f7a04d-8501-4bd7-b739-d22be7d0a20d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2fa76113-535b-454e-b05b-22812260cdfb {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5fb1865-55f9-44c4-a4cb-571842d2a206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2eb09f8-ca37-43fe-b692-5250d131c0b5', 'volume_size': 1, 'snapshot_id': 'f0a029e1-db43-4e4d-97b5-3c550e6885d2'}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38000a22-8ba9-408c-bbc2-220a3f444486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f5f7a04d-8501-4bd7-b739-d22be7d0a20d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2fa76113-535b-454e-b05b-22812260cdfb" returned: 0 in 0.291s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:16 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f5f7a04d-8501-4bd7-b739-d22be7d0a20d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] <== create_volume: return (726ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 12:14:16 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f5f7a04d-8501-4bd7-b739-d22be7d0a20d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:14:16 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Volume volume-f2eb09f8-ca37-43fe-b692-5250d131c0b5 (f2eb09f8-ca37-43fe-b692-5250d131c0b5): created successfully
Sep 18 12:14:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38000a22-8ba9-408c-bbc2-220a3f444486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Flow 'volume_create_manager' (909fa6fe-b35d-4be9-a6c5-a1f658dff09a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:14:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f5f7a04d-8501-4bd7-b739-d22be7d0a20d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc520a7d-54c7-401d-a985-1ebfec3ad550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fa76113-535b-454e-b05b-22812260cdfb', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f5f7a04d-8501-4bd7-b739-d22be7d0a20d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7276b318-2a48-4968-862b-33a3b855341e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:16 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-cd20440a-9fc5-4e35-a90a-d8ccd40a3d17 tempest-SnapshotDependencyTests-1254484672 None] Created volume successfully.
Sep 18 12:14:16 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-f5f7a04d-8501-4bd7-b739-d22be7d0a20d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Volume volume-2fa76113-535b-454e-b05b-22812260cdfb (2fa76113-535b-454e-b05b-22812260cdfb): created successfully
Sep 18 12:14:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f5f7a04d-8501-4bd7-b739-d22be7d0a20d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7276b318-2a48-4968-862b-33a3b855341e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:16 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-f5f7a04d-8501-4bd7-b739-d22be7d0a20d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Flow 'volume_create_manager' (18e7a483-1e10-4fdf-bde8-7e3dd913495d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:14:16 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-f5f7a04d-8501-4bd7-b739-d22be7d0a20d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Created volume successfully.
Sep 18 12:14:17 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-e44ed548-014d-4dff-ac8a-d69e892e7ec3 tempest-SnapshotDependencyTests-1254484672 None] Acquiring lock "cinder-f0a029e1-db43-4e4d-97b5-3c550e6885d2-delete_snapshot" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:14:17 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-e44ed548-014d-4dff-ac8a-d69e892e7ec3 tempest-SnapshotDependencyTests-1254484672 None] Lock "cinder-f0a029e1-db43-4e4d-97b5-3c550e6885d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:14:17 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-e44ed548-014d-4dff-ac8a-d69e892e7ec3 tempest-SnapshotDependencyTests-1254484672 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:14:17 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-e44ed548-014d-4dff-ac8a-d69e892e7ec3 tempest-SnapshotDependencyTests-1254484672 None] Acquiring lock "cinder-quobyte-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b" by "delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:14:17 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-e44ed548-014d-4dff-ac8a-d69e892e7ec3 tempest-SnapshotDependencyTests-1254484672 None] Lock "cinder-quobyte-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:14:17 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-e44ed548-014d-4dff-ac8a-d69e892e7ec3 tempest-SnapshotDependencyTests-1254484672 None] Acquiring lock "cinder-quobyte-f0a029e1-db43-4e4d-97b5-3c550e6885d2" by "_delete_snapshot" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:14:17 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-e44ed548-014d-4dff-ac8a-d69e892e7ec3 tempest-SnapshotDependencyTests-1254484672 None] Lock "cinder-quobyte-f0a029e1-db43-4e4d-97b5-3c550e6885d2" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:14:17 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-e44ed548-014d-4dff-ac8a-d69e892e7ec3 tempest-SnapshotDependencyTests-1254484672 None] Deleting offline snapshot f0a029e1-db43-4e4d-97b5-3c550e6885d2 of volume 8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 12:14:17 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-e44ed548-014d-4dff-ac8a-d69e892e7ec3 tempest-SnapshotDependencyTests-1254484672 None] snapshot_file for this snap is: volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b.f0a029e1-db43-4e4d-97b5-3c550e6885d2 {{(pid=83176) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 12:14:17 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[03366428-a712-40c3-95f9-a66c6d7189b5]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:14:17 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-e44ed548-014d-4dff-ac8a-d69e892e7ec3 tempest-SnapshotDependencyTests-1254484672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b.f0a029e1-db43-4e4d-97b5-3c550e6885d2 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:18 devstack quobyte-client[83193]: System call of process 101064 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 12:14:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-e44ed548-014d-4dff-ac8a-d69e892e7ec3 tempest-SnapshotDependencyTests-1254484672 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b.f0a029e1-db43-4e4d-97b5-3c550e6885d2" returned: 0 in 0.584s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:18 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-e44ed548-014d-4dff-ac8a-d69e892e7ec3 tempest-SnapshotDependencyTests-1254484672 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83176) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 12:14:18 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-981de549-8f8a-4f4f-919b-6d6e935f4e2d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:14:18 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-981de549-8f8a-4f4f-919b-6d6e935f4e2d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 12:14:18 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-981de549-8f8a-4f4f-919b-6d6e935f4e2d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Flow 'volume_create_manager' (61512495-072e-4383-847d-08043018fecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:14:18 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-981de549-8f8a-4f4f-919b-6d6e935f4e2d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e15c6696-3110-44aa-b760-d06d4339d7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:18 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea59cbb3-d627-4393-b38b-65c5b1c22c43]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:14:18 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-e44ed548-014d-4dff-ac8a-d69e892e7ec3 tempest-SnapshotDependencyTests-1254484672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:19 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-80eeeec0-d1bc-4450-9083-8f4eb8e5a6d4 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:14:19 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-80eeeec0-d1bc-4450-9083-8f4eb8e5a6d4 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 12:14:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-80eeeec0-d1bc-4450-9083-8f4eb8e5a6d4 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Flow 'volume_create_manager' (ae0fa7fb-3fbd-4b62-99c8-1afff48addac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:14:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-80eeeec0-d1bc-4450-9083-8f4eb8e5a6d4 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b01e3bc2-3897-43a5-bae3-857657a87e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-981de549-8f8a-4f4f-919b-6d6e935f4e2d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e15c6696-3110-44aa-b760-d06d4339d7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1034975596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bcaf56b-3259-4aa2-bb10-982ab95ab12e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='520f2259f04849498d55ecfd28a09cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:14:18Z,use_quota=True,user_id='2e34fa458ab64f3390ec19204f3341e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-981de549-8f8a-4f4f-919b-6d6e935f4e2d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7430c15b-946c-4c84-8852-301a0ab15a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-981de549-8f8a-4f4f-919b-6d6e935f4e2d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7430c15b-946c-4c84-8852-301a0ab15a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-981de549-8f8a-4f4f-919b-6d6e935f4e2d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d1b2fde-f5ab-45d5-917f-7c8c37b696cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-981de549-8f8a-4f4f-919b-6d6e935f4e2d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d1b2fde-f5ab-45d5-917f-7c8c37b696cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bcaf56b-3259-4aa2-bb10-982ab95ab12e', 'volume_name': 'volume-5bcaf56b-3259-4aa2-bb10-982ab95ab12e', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-981de549-8f8a-4f4f-919b-6d6e935f4e2d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99c1ef19-484d-4c89-837f-4e4dfc664a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-981de549-8f8a-4f4f-919b-6d6e935f4e2d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99c1ef19-484d-4c89-837f-4e4dfc664a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-981de549-8f8a-4f4f-919b-6d6e935f4e2d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2654f7a8-e5ee-4abc-9fcd-17bec98fec92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:19 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-981de549-8f8a-4f4f-919b-6d6e935f4e2d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Volume 5bcaf56b-3259-4aa2-bb10-982ab95ab12e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bcaf56b-3259-4aa2-bb10-982ab95ab12e', 'volume_size': 1}
Sep 18 12:14:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-981de549-8f8a-4f4f-919b-6d6e935f4e2d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:14:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-981de549-8f8a-4f4f-919b-6d6e935f4e2d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:14:19 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-981de549-8f8a-4f4f-919b-6d6e935f4e2d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1034975596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bcaf56b-3259-4aa2-bb10-982ab95ab12e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='520f2259f04849498d55ecfd28a09cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:14:18Z,use_quota=True,user_id='2e34fa458ab64f3390ec19204f3341e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 12:14:19 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-981de549-8f8a-4f4f-919b-6d6e935f4e2d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Creating volume 5bcaf56b-3259-4aa2-bb10-982ab95ab12e {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 12:14:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-981de549-8f8a-4f4f-919b-6d6e935f4e2d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:14:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-981de549-8f8a-4f4f-919b-6d6e935f4e2d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:14:19 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-981de549-8f8a-4f4f-919b-6d6e935f4e2d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:14:19 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-981de549-8f8a-4f4f-919b-6d6e935f4e2d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:14:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-981de549-8f8a-4f4f-919b-6d6e935f4e2d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:14:19 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-981de549-8f8a-4f4f-919b-6d6e935f4e2d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 12:14:19 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-981de549-8f8a-4f4f-919b-6d6e935f4e2d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 12:14:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-981de549-8f8a-4f4f-919b-6d6e935f4e2d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5bcaf56b-3259-4aa2-bb10-982ab95ab12e 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:19 devstack quobyte-client[83193]: System call of process 101070 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 12:14:19 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=169, name=volume-5bcaf56b-3259-4aa2-bb10-982ab95ab12e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:14:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-80eeeec0-d1bc-4450-9083-8f4eb8e5a6d4 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b01e3bc2-3897-43a5-bae3-857657a87e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1286056822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=149ec200-1b48-429f-baf0-eebb7ca02d9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='520f2259f04849498d55ecfd28a09cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:14:18Z,use_quota=True,user_id='2e34fa458ab64f3390ec19204f3341e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-80eeeec0-d1bc-4450-9083-8f4eb8e5a6d4 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (022a9d35-b056-4f73-96f4-de3101f25ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-80eeeec0-d1bc-4450-9083-8f4eb8e5a6d4 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (022a9d35-b056-4f73-96f4-de3101f25ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-80eeeec0-d1bc-4450-9083-8f4eb8e5a6d4 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5784326d-9de3-4048-bbf4-1c88f8371d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-80eeeec0-d1bc-4450-9083-8f4eb8e5a6d4 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5784326d-9de3-4048-bbf4-1c88f8371d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '149ec200-1b48-429f-baf0-eebb7ca02d9f', 'volume_name': 'volume-149ec200-1b48-429f-baf0-eebb7ca02d9f', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-80eeeec0-d1bc-4450-9083-8f4eb8e5a6d4 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3ba5b29-7780-49b7-a96b-e431f66e6fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-80eeeec0-d1bc-4450-9083-8f4eb8e5a6d4 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3ba5b29-7780-49b7-a96b-e431f66e6fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:19 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-80eeeec0-d1bc-4450-9083-8f4eb8e5a6d4 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7db9533b-1544-4f74-b47c-3229d1226f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:19 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-80eeeec0-d1bc-4450-9083-8f4eb8e5a6d4 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Volume 149ec200-1b48-429f-baf0-eebb7ca02d9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-149ec200-1b48-429f-baf0-eebb7ca02d9f', 'volume_size': 1}
Sep 18 12:14:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-80eeeec0-d1bc-4450-9083-8f4eb8e5a6d4 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:14:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-e44ed548-014d-4dff-ac8a-d69e892e7ec3 tempest-SnapshotDependencyTests-1254484672 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b" returned: 0 in 1.436s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:19 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-e44ed548-014d-4dff-ac8a-d69e892e7ec3 tempest-SnapshotDependencyTests-1254484672 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b.f0a029e1-db43-4e4d-97b5-3c550e6885d2 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:20 devstack quobyte-client[83193]: System call of process 101073 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 12:14:20 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-e7643344-4753-41af-884e-35dd989f2f91 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:14:20 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7643344-4753-41af-884e-35dd989f2f91 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 12:14:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-e7643344-4753-41af-884e-35dd989f2f91 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Flow 'volume_create_manager' (89adeda6-c647-42d3-a38f-97c15d3c4ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:14:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-e7643344-4753-41af-884e-35dd989f2f91 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a76bf859-e821-4db0-8a45-67bc8136aa0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-981de549-8f8a-4f4f-919b-6d6e935f4e2d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5bcaf56b-3259-4aa2-bb10-982ab95ab12e 1073741824" returned: 0 in 1.140s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-981de549-8f8a-4f4f-919b-6d6e935f4e2d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5bcaf56b-3259-4aa2-bb10-982ab95ab12e {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-e7643344-4753-41af-884e-35dd989f2f91 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a76bf859-e821-4db0-8a45-67bc8136aa0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-875736136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=660acc19-ea7d-4a7d-a6c7-b210bd41b19c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='520f2259f04849498d55ecfd28a09cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:14:19Z,use_quota=True,user_id='2e34fa458ab64f3390ec19204f3341e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-e7643344-4753-41af-884e-35dd989f2f91 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76a47bee-86a3-452a-8d43-c97e8c489659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-e7643344-4753-41af-884e-35dd989f2f91 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76a47bee-86a3-452a-8d43-c97e8c489659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-e7643344-4753-41af-884e-35dd989f2f91 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2136a33a-4bbe-4c94-ba47-e48c5f159797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-e7643344-4753-41af-884e-35dd989f2f91 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2136a33a-4bbe-4c94-ba47-e48c5f159797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '660acc19-ea7d-4a7d-a6c7-b210bd41b19c', 'volume_name': 'volume-660acc19-ea7d-4a7d-a6c7-b210bd41b19c', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-e7643344-4753-41af-884e-35dd989f2f91 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da552105-80d4-4dbc-8d1e-317b554dac71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-e7643344-4753-41af-884e-35dd989f2f91 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da552105-80d4-4dbc-8d1e-317b554dac71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-e7643344-4753-41af-884e-35dd989f2f91 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f308a2e7-ebc8-421d-8642-2745841c2d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:20 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-e7643344-4753-41af-884e-35dd989f2f91 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Volume 660acc19-ea7d-4a7d-a6c7-b210bd41b19c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-660acc19-ea7d-4a7d-a6c7-b210bd41b19c', 'volume_size': 1}
Sep 18 12:14:20 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-e7643344-4753-41af-884e-35dd989f2f91 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:14:20 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-40deaea9-4f8e-4600-89e6-f84ac6805399 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:14:20 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-40deaea9-4f8e-4600-89e6-f84ac6805399 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 12:14:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-40deaea9-4f8e-4600-89e6-f84ac6805399 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Flow 'volume_create_manager' (27caf29c-c324-48dc-b41f-7ba0587ba949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:14:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-40deaea9-4f8e-4600-89e6-f84ac6805399 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d81f1c2-1836-48c8-bb04-e0d2effe7a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:20 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-0684ddc9-bd67-46ef-a177-9dc05b3ad15c tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:14:20 devstack cinder-volume[83176]: DEBUG cinder.volume.flows.manager.create_volume [None req-0684ddc9-bd67-46ef-a177-9dc05b3ad15c tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83176) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 18 12:14:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0684ddc9-bd67-46ef-a177-9dc05b3ad15c tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Flow 'volume_create_manager' (a475ca69-5888-41ab-901b-ded15b825d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:14:20 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0684ddc9-bd67-46ef-a177-9dc05b3ad15c tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fa0cf8e-5071-4c72-9c6e-2fce50a7ba8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-e44ed548-014d-4dff-ac8a-d69e892e7ec3 tempest-SnapshotDependencyTests-1254484672 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b.f0a029e1-db43-4e4d-97b5-3c550e6885d2" returned: 0 in 1.021s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-e44ed548-014d-4dff-ac8a-d69e892e7ec3 tempest-SnapshotDependencyTests-1254484672 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b.f0a029e1-db43-4e4d-97b5-3c550e6885d2 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-981de549-8f8a-4f4f-919b-6d6e935f4e2d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5bcaf56b-3259-4aa2-bb10-982ab95ab12e" returned: 0 in 0.765s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:21 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-981de549-8f8a-4f4f-919b-6d6e935f4e2d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] <== create_volume: return (1996ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 12:14:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-981de549-8f8a-4f4f-919b-6d6e935f4e2d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.010s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:14:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-80eeeec0-d1bc-4450-9083-8f4eb8e5a6d4 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.458s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:14:21 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-80eeeec0-d1bc-4450-9083-8f4eb8e5a6d4 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1286056822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=149ec200-1b48-429f-baf0-eebb7ca02d9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='520f2259f04849498d55ecfd28a09cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:14:18Z,use_quota=True,user_id='2e34fa458ab64f3390ec19204f3341e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 12:14:21 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-80eeeec0-d1bc-4450-9083-8f4eb8e5a6d4 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Creating volume 149ec200-1b48-429f-baf0-eebb7ca02d9f {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 12:14:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-80eeeec0-d1bc-4450-9083-8f4eb8e5a6d4 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:14:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-80eeeec0-d1bc-4450-9083-8f4eb8e5a6d4 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:14:21 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-80eeeec0-d1bc-4450-9083-8f4eb8e5a6d4 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:14:21 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-80eeeec0-d1bc-4450-9083-8f4eb8e5a6d4 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:14:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-80eeeec0-d1bc-4450-9083-8f4eb8e5a6d4 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:14:21 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-80eeeec0-d1bc-4450-9083-8f4eb8e5a6d4 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 12:14:21 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-80eeeec0-d1bc-4450-9083-8f4eb8e5a6d4 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 12:14:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-80eeeec0-d1bc-4450-9083-8f4eb8e5a6d4 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-149ec200-1b48-429f-baf0-eebb7ca02d9f 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:21 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=170, name=volume-149ec200-1b48-429f-baf0-eebb7ca02d9f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:14:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-40deaea9-4f8e-4600-89e6-f84ac6805399 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d81f1c2-1836-48c8-bb04-e0d2effe7a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-389135938',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c91b144e-de1f-4deb-bd9e-9161d96910ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='520f2259f04849498d55ecfd28a09cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:14:19Z,use_quota=True,user_id='2e34fa458ab64f3390ec19204f3341e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-40deaea9-4f8e-4600-89e6-f84ac6805399 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20dd4ef3-86df-41fe-b5db-521fd336b124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-40deaea9-4f8e-4600-89e6-f84ac6805399 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20dd4ef3-86df-41fe-b5db-521fd336b124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-40deaea9-4f8e-4600-89e6-f84ac6805399 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (297a4638-5ded-44ea-85f8-7040dbffc6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-40deaea9-4f8e-4600-89e6-f84ac6805399 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (297a4638-5ded-44ea-85f8-7040dbffc6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c91b144e-de1f-4deb-bd9e-9161d96910ca', 'volume_name': 'volume-c91b144e-de1f-4deb-bd9e-9161d96910ca', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-40deaea9-4f8e-4600-89e6-f84ac6805399 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d9be180-e4bd-43a2-8e14-ef733aedd47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-40deaea9-4f8e-4600-89e6-f84ac6805399 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d9be180-e4bd-43a2-8e14-ef733aedd47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-40deaea9-4f8e-4600-89e6-f84ac6805399 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f2ea87e-0117-44e4-af10-a5ea108ca9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:21 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-40deaea9-4f8e-4600-89e6-f84ac6805399 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Volume c91b144e-de1f-4deb-bd9e-9161d96910ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c91b144e-de1f-4deb-bd9e-9161d96910ca', 'volume_size': 1}
Sep 18 12:14:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-40deaea9-4f8e-4600-89e6-f84ac6805399 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:14:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0684ddc9-bd67-46ef-a177-9dc05b3ad15c tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fa0cf8e-5071-4c72-9c6e-2fce50a7ba8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2081414647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08ad404c-e29c-4e67-84d6-e01d4487baaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='520f2259f04849498d55ecfd28a09cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:14:20Z,use_quota=True,user_id='2e34fa458ab64f3390ec19204f3341e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0684ddc9-bd67-46ef-a177-9dc05b3ad15c tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f924cfc5-eb18-4647-b6a6-cc74ce688dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0684ddc9-bd67-46ef-a177-9dc05b3ad15c tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f924cfc5-eb18-4647-b6a6-cc74ce688dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0684ddc9-bd67-46ef-a177-9dc05b3ad15c tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ba272bc-800b-48f5-be42-a62268f06b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0684ddc9-bd67-46ef-a177-9dc05b3ad15c tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ba272bc-800b-48f5-be42-a62268f06b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08ad404c-e29c-4e67-84d6-e01d4487baaf', 'volume_name': 'volume-08ad404c-e29c-4e67-84d6-e01d4487baaf', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0684ddc9-bd67-46ef-a177-9dc05b3ad15c tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd3239ca-0182-4deb-a130-7b73c1fe1103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0684ddc9-bd67-46ef-a177-9dc05b3ad15c tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd3239ca-0182-4deb-a130-7b73c1fe1103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0684ddc9-bd67-46ef-a177-9dc05b3ad15c tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59a86168-e073-4d8a-ac0c-76bb957f49fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:21 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-0684ddc9-bd67-46ef-a177-9dc05b3ad15c tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Volume 08ad404c-e29c-4e67-84d6-e01d4487baaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08ad404c-e29c-4e67-84d6-e01d4487baaf', 'volume_size': 1}
Sep 18 12:14:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0684ddc9-bd67-46ef-a177-9dc05b3ad15c tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:14:21 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-e44ed548-014d-4dff-ac8a-d69e892e7ec3 tempest-SnapshotDependencyTests-1254484672 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b.f0a029e1-db43-4e4d-97b5-3c550e6885d2" returned: 0 in 0.837s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-981de549-8f8a-4f4f-919b-6d6e935f4e2d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2654f7a8-e5ee-4abc-9fcd-17bec98fec92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bcaf56b-3259-4aa2-bb10-982ab95ab12e', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:21 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-981de549-8f8a-4f4f-919b-6d6e935f4e2d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de7ad696-ab09-4c94-836e-7da32c2d63f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-80eeeec0-d1bc-4450-9083-8f4eb8e5a6d4 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-149ec200-1b48-429f-baf0-eebb7ca02d9f 1073741824" returned: 0 in 0.621s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:22 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-e44ed548-014d-4dff-ac8a-d69e892e7ec3 tempest-SnapshotDependencyTests-1254484672 None] Lock "cinder-quobyte-f0a029e1-db43-4e4d-97b5-3c550e6885d2" released by "_delete_snapshot" :: held 4.286s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:14:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-80eeeec0-d1bc-4450-9083-8f4eb8e5a6d4 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-149ec200-1b48-429f-baf0-eebb7ca02d9f {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:22 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-981de549-8f8a-4f4f-919b-6d6e935f4e2d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Volume volume-5bcaf56b-3259-4aa2-bb10-982ab95ab12e (5bcaf56b-3259-4aa2-bb10-982ab95ab12e): created successfully
Sep 18 12:14:22 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-981de549-8f8a-4f4f-919b-6d6e935f4e2d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de7ad696-ab09-4c94-836e-7da32c2d63f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:22 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-981de549-8f8a-4f4f-919b-6d6e935f4e2d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Flow 'volume_create_manager' (61512495-072e-4383-847d-08043018fecf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:14:22 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-e44ed548-014d-4dff-ac8a-d69e892e7ec3 tempest-SnapshotDependencyTests-1254484672 None] Lock "cinder-quobyte-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b" released by "delete_snapshot" :: held 4.638s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:14:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-80eeeec0-d1bc-4450-9083-8f4eb8e5a6d4 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-149ec200-1b48-429f-baf0-eebb7ca02d9f" returned: 0 in 0.437s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:22 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-80eeeec0-d1bc-4450-9083-8f4eb8e5a6d4 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] <== create_volume: return (1099ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 12:14:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-80eeeec0-d1bc-4450-9083-8f4eb8e5a6d4 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:14:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-e7643344-4753-41af-884e-35dd989f2f91 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.668s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:14:22 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-e7643344-4753-41af-884e-35dd989f2f91 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-875736136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=660acc19-ea7d-4a7d-a6c7-b210bd41b19c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='520f2259f04849498d55ecfd28a09cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:14:19Z,use_quota=True,user_id='2e34fa458ab64f3390ec19204f3341e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 12:14:22 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-e7643344-4753-41af-884e-35dd989f2f91 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Creating volume 660acc19-ea7d-4a7d-a6c7-b210bd41b19c {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 12:14:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-e7643344-4753-41af-884e-35dd989f2f91 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:14:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-e7643344-4753-41af-884e-35dd989f2f91 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:14:22 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-e7643344-4753-41af-884e-35dd989f2f91 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:14:22 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-e7643344-4753-41af-884e-35dd989f2f91 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:14:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-e7643344-4753-41af-884e-35dd989f2f91 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:14:22 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-e7643344-4753-41af-884e-35dd989f2f91 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 12:14:22 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-e7643344-4753-41af-884e-35dd989f2f91 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 12:14:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-e7643344-4753-41af-884e-35dd989f2f91 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-660acc19-ea7d-4a7d-a6c7-b210bd41b19c 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:22 devstack quobyte-client[83193]: System call of process 101082 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 12:14:22 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=171, name=volume-660acc19-ea7d-4a7d-a6c7-b210bd41b19c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:14:22 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-80eeeec0-d1bc-4450-9083-8f4eb8e5a6d4 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7db9533b-1544-4f74-b47c-3229d1226f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-149ec200-1b48-429f-baf0-eebb7ca02d9f', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:22 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-80eeeec0-d1bc-4450-9083-8f4eb8e5a6d4 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b51abc1d-15e8-460d-8a8c-bbab9c7809d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:22 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-981de549-8f8a-4f4f-919b-6d6e935f4e2d tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Created volume successfully.
Sep 18 12:14:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-e7643344-4753-41af-884e-35dd989f2f91 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-660acc19-ea7d-4a7d-a6c7-b210bd41b19c 1073741824" returned: 0 in 0.444s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:22 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-e7643344-4753-41af-884e-35dd989f2f91 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-660acc19-ea7d-4a7d-a6c7-b210bd41b19c {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:23 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-80eeeec0-d1bc-4450-9083-8f4eb8e5a6d4 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Volume volume-149ec200-1b48-429f-baf0-eebb7ca02d9f (149ec200-1b48-429f-baf0-eebb7ca02d9f): created successfully
Sep 18 12:14:23 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-80eeeec0-d1bc-4450-9083-8f4eb8e5a6d4 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b51abc1d-15e8-460d-8a8c-bbab9c7809d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:23 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-80eeeec0-d1bc-4450-9083-8f4eb8e5a6d4 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Flow 'volume_create_manager' (ae0fa7fb-3fbd-4b62-99c8-1afff48addac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:14:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-e7643344-4753-41af-884e-35dd989f2f91 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-660acc19-ea7d-4a7d-a6c7-b210bd41b19c" returned: 0 in 0.486s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:23 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-e7643344-4753-41af-884e-35dd989f2f91 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] <== create_volume: return (971ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 12:14:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-e7643344-4753-41af-884e-35dd989f2f91 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:14:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-40deaea9-4f8e-4600-89e6-f84ac6805399 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.798s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:14:23 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-40deaea9-4f8e-4600-89e6-f84ac6805399 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-389135938',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c91b144e-de1f-4deb-bd9e-9161d96910ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='520f2259f04849498d55ecfd28a09cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:14:19Z,use_quota=True,user_id='2e34fa458ab64f3390ec19204f3341e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 12:14:23 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-40deaea9-4f8e-4600-89e6-f84ac6805399 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Creating volume c91b144e-de1f-4deb-bd9e-9161d96910ca {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 12:14:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-40deaea9-4f8e-4600-89e6-f84ac6805399 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:14:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-40deaea9-4f8e-4600-89e6-f84ac6805399 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:14:23 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-40deaea9-4f8e-4600-89e6-f84ac6805399 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:14:23 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-40deaea9-4f8e-4600-89e6-f84ac6805399 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:14:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-40deaea9-4f8e-4600-89e6-f84ac6805399 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:14:23 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-40deaea9-4f8e-4600-89e6-f84ac6805399 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 12:14:23 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-40deaea9-4f8e-4600-89e6-f84ac6805399 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 12:14:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-40deaea9-4f8e-4600-89e6-f84ac6805399 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c91b144e-de1f-4deb-bd9e-9161d96910ca 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:23 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-80eeeec0-d1bc-4450-9083-8f4eb8e5a6d4 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Created volume successfully.
Sep 18 12:14:23 devstack quobyte-client[83193]: System call of process 101086 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 12:14:23 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=172, name=volume-c91b144e-de1f-4deb-bd9e-9161d96910ca, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:14:23 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-e7643344-4753-41af-884e-35dd989f2f91 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f308a2e7-ebc8-421d-8642-2745841c2d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-660acc19-ea7d-4a7d-a6c7-b210bd41b19c', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:23 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-e7643344-4753-41af-884e-35dd989f2f91 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f4ab6e0-da8c-4709-bdd8-5379805fb1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:23 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-e44ed548-014d-4dff-ac8a-d69e892e7ec3 tempest-SnapshotDependencyTests-1254484672 None] Created reservations ['ddddebee-d332-4007-90f8-36236b0ea38a', '106a1574-61d3-4cf2-8fa7-95497287109c', 'a7538786-9e90-4d1f-9060-89b648f96602', '67cc7dfe-5c45-4bcb-abe1-d26cc80b84b8'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:14:23 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-40deaea9-4f8e-4600-89e6-f84ac6805399 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c91b144e-de1f-4deb-bd9e-9161d96910ca 1073741824" returned: 0 in 0.493s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-40deaea9-4f8e-4600-89e6-f84ac6805399 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c91b144e-de1f-4deb-bd9e-9161d96910ca {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:24 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-e7643344-4753-41af-884e-35dd989f2f91 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Volume volume-660acc19-ea7d-4a7d-a6c7-b210bd41b19c (660acc19-ea7d-4a7d-a6c7-b210bd41b19c): created successfully
Sep 18 12:14:24 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-e7643344-4753-41af-884e-35dd989f2f91 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f4ab6e0-da8c-4709-bdd8-5379805fb1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:24 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-e7643344-4753-41af-884e-35dd989f2f91 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Flow 'volume_create_manager' (89adeda6-c647-42d3-a38f-97c15d3c4ba0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:14:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-40deaea9-4f8e-4600-89e6-f84ac6805399 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c91b144e-de1f-4deb-bd9e-9161d96910ca" returned: 0 in 0.428s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:24 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-40deaea9-4f8e-4600-89e6-f84ac6805399 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] <== create_volume: return (947ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 12:14:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-40deaea9-4f8e-4600-89e6-f84ac6805399 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:14:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0684ddc9-bd67-46ef-a177-9dc05b3ad15c tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.700s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:14:24 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-0684ddc9-bd67-46ef-a177-9dc05b3ad15c tempest-CreateVolumesFromSourceVolumeTest-786174884 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6ae5191480>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T10:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2081414647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08ad404c-e29c-4e67-84d6-e01d4487baaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='520f2259f04849498d55ecfd28a09cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:14:20Z,use_quota=True,user_id='2e34fa458ab64f3390ec19204f3341e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf049e53-db24-4b11-82c1-cea217aa9636),volume_type_id=bf049e53-db24-4b11-82c1-cea217aa9636)}" {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 12:14:24 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.remotefs [None req-0684ddc9-bd67-46ef-a177-9dc05b3ad15c tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Creating volume 08ad404c-e29c-4e67-84d6-e01d4487baaf {{(pid=83176) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 12:14:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0684ddc9-bd67-46ef-a177-9dc05b3ad15c tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:14:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0684ddc9-bd67-46ef-a177-9dc05b3ad15c tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:14:24 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-0684ddc9-bd67-46ef-a177-9dc05b3ad15c tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:14:24 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-0684ddc9-bd67-46ef-a177-9dc05b3ad15c tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:14:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0684ddc9-bd67-46ef-a177-9dc05b3ad15c tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:14:24 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-0684ddc9-bd67-46ef-a177-9dc05b3ad15c tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Selected 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8 as target Quobyte volume. {{(pid=83176) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 12:14:24 devstack cinder-volume[83176]: INFO cinder.volume.drivers.remotefs [None req-0684ddc9-bd67-46ef-a177-9dc05b3ad15c tempest-CreateVolumesFromSourceVolumeTest-786174884 None] casted to 10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8
Sep 18 12:14:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0684ddc9-bd67-46ef-a177-9dc05b3ad15c tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-08ad404c-e29c-4e67-84d6-e01d4487baaf 1073741824 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:24 devstack quobyte-client[83193]: System call of process 101090 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 12:14:24 devstack quobyte-client[83193]: System call of process 101090 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 12:14:24 devstack quobyte-client[83193]: System call of process 101090 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 12:14:24 devstack quobyte-client[83193]: System call of process 101090 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 12:14:24 devstack quobyte-client[83193]: The server volume:a52b8242-31e0-4aec-a351-c1a6cf8fe36f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a52b8242-31e0-4aec-a351-c1a6cf8fe36f, inode=173, name=volume-08ad404c-e29c-4e67-84d6-e01d4487baaf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.182), requestorAccessMask=0
Sep 18 12:14:24 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-e7643344-4753-41af-884e-35dd989f2f91 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Created volume successfully.
Sep 18 12:14:24 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-40deaea9-4f8e-4600-89e6-f84ac6805399 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f2ea87e-0117-44e4-af10-a5ea108ca9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c91b144e-de1f-4deb-bd9e-9161d96910ca', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:24 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-40deaea9-4f8e-4600-89e6-f84ac6805399 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae0ce2c8-082b-4e59-9878-48cdedebba9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0684ddc9-bd67-46ef-a177-9dc05b3ad15c tempest-CreateVolumesFromSourceVolumeTest-786174884 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-08ad404c-e29c-4e67-84d6-e01d4487baaf 1073741824" returned: 0 in 0.472s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:24 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0684ddc9-bd67-46ef-a177-9dc05b3ad15c tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-08ad404c-e29c-4e67-84d6-e01d4487baaf {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:25 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-40deaea9-4f8e-4600-89e6-f84ac6805399 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Volume volume-c91b144e-de1f-4deb-bd9e-9161d96910ca (c91b144e-de1f-4deb-bd9e-9161d96910ca): created successfully
Sep 18 12:14:25 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-40deaea9-4f8e-4600-89e6-f84ac6805399 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae0ce2c8-082b-4e59-9878-48cdedebba9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:25 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-40deaea9-4f8e-4600-89e6-f84ac6805399 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Flow 'volume_create_manager' (27caf29c-c324-48dc-b41f-7ba0587ba949) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:14:25 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-01c2beb8-aac6-4dd0-979d-57da5065a53a tempest-SnapshotDependencyTests-1254484672 None] Acquiring lock "cinder-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:14:25 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-e44ed548-014d-4dff-ac8a-d69e892e7ec3 tempest-SnapshotDependencyTests-1254484672 None] Delete snapshot completed successfully.
Sep 18 12:14:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0684ddc9-bd67-46ef-a177-9dc05b3ad15c tempest-CreateVolumesFromSourceVolumeTest-786174884 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-08ad404c-e29c-4e67-84d6-e01d4487baaf" returned: 0 in 0.513s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:25 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-0684ddc9-bd67-46ef-a177-9dc05b3ad15c tempest-CreateVolumesFromSourceVolumeTest-786174884 None] <== create_volume: return (1026ms) {'provider_location': '10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'} {{(pid=83176) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 12:14:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0684ddc9-bd67-46ef-a177-9dc05b3ad15c tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:14:25 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-40deaea9-4f8e-4600-89e6-f84ac6805399 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Created volume successfully.
Sep 18 12:14:25 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-e44ed548-014d-4dff-ac8a-d69e892e7ec3 tempest-SnapshotDependencyTests-1254484672 None] Lock "cinder-f0a029e1-db43-4e4d-97b5-3c550e6885d2-delete_snapshot" released by "delete_snapshot" :: held 7.866s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:14:25 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-01c2beb8-aac6-4dd0-979d-57da5065a53a tempest-SnapshotDependencyTests-1254484672 None] Lock "cinder-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b-delete_volume" acquired by "delete_volume" :: waited 0.137s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:14:25 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0684ddc9-bd67-46ef-a177-9dc05b3ad15c tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59a86168-e073-4d8a-ac0c-76bb957f49fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08ad404c-e29c-4e67-84d6-e01d4487baaf', 'volume_size': 1}' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:25 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0684ddc9-bd67-46ef-a177-9dc05b3ad15c tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf43d41-14d8-4698-970a-7ca55cc65e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 12:14:25 devstack cinder-volume[83176]: INFO cinder.volume.flows.manager.create_volume [None req-0684ddc9-bd67-46ef-a177-9dc05b3ad15c tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Volume volume-08ad404c-e29c-4e67-84d6-e01d4487baaf (08ad404c-e29c-4e67-84d6-e01d4487baaf): created successfully
Sep 18 12:14:25 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0684ddc9-bd67-46ef-a177-9dc05b3ad15c tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf43d41-14d8-4698-970a-7ca55cc65e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83176) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 12:14:25 devstack cinder-volume[83176]: DEBUG cinder.volume.manager [None req-0684ddc9-bd67-46ef-a177-9dc05b3ad15c tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Flow 'volume_create_manager' (a475ca69-5888-41ab-901b-ded15b825d1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83176) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 12:14:25 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-0684ddc9-bd67-46ef-a177-9dc05b3ad15c tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Created volume successfully.
Sep 18 12:14:25 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-01c2beb8-aac6-4dd0-979d-57da5065a53a tempest-SnapshotDependencyTests-1254484672 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:14:25 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-01c2beb8-aac6-4dd0-979d-57da5065a53a tempest-SnapshotDependencyTests-1254484672 None] Acquiring lock "cinder-quobyte-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:14:25 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-01c2beb8-aac6-4dd0-979d-57da5065a53a tempest-SnapshotDependencyTests-1254484672 None] Lock "cinder-quobyte-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b" acquired by "delete_volume" :: waited 0.013s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:14:25 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca413ea-9721-400d-87ca-a30c6fadf7a0]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:14:25 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-01c2beb8-aac6-4dd0-979d-57da5065a53a tempest-SnapshotDependencyTests-1254484672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-01c2beb8-aac6-4dd0-979d-57da5065a53a tempest-SnapshotDependencyTests-1254484672 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b" returned: 0 in 0.398s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-01c2beb8-aac6-4dd0-979d-57da5065a53a tempest-SnapshotDependencyTests-1254484672 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-01c2beb8-aac6-4dd0-979d-57da5065a53a tempest-SnapshotDependencyTests-1254484672 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b" returned: 0 in 0.093s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:26 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-01c2beb8-aac6-4dd0-979d-57da5065a53a tempest-SnapshotDependencyTests-1254484672 None] Lock "cinder-quobyte-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b" released by "delete_volume" :: held 0.670s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:14:26 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-01c2beb8-aac6-4dd0-979d-57da5065a53a tempest-SnapshotDependencyTests-1254484672 None] Created reservations ['5f54868a-18c7-48f9-b06e-4666a27ed21e', '9bfa401f-9097-410e-b90b-de0445087f98', 'af2c624b-bcef-49d0-b8cf-de5ca7973e93', '86804a36-be7c-4ec9-8134-47be5c3bccc7'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:14:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-01c2beb8-aac6-4dd0-979d-57da5065a53a tempest-SnapshotDependencyTests-1254484672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:14:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-01c2beb8-aac6-4dd0-979d-57da5065a53a tempest-SnapshotDependencyTests-1254484672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:14:26 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-01c2beb8-aac6-4dd0-979d-57da5065a53a tempest-SnapshotDependencyTests-1254484672 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:14:26 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-01c2beb8-aac6-4dd0-979d-57da5065a53a tempest-SnapshotDependencyTests-1254484672 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:14:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-01c2beb8-aac6-4dd0-979d-57da5065a53a tempest-SnapshotDependencyTests-1254484672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:14:26 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-01c2beb8-aac6-4dd0-979d-57da5065a53a tempest-SnapshotDependencyTests-1254484672 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:27 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0ecc9fae-7a56-4552-8fc1-2a885e2ed4f0 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Acquiring lock "cinder-08ad404c-e29c-4e67-84d6-e01d4487baaf-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:14:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-01c2beb8-aac6-4dd0-979d-57da5065a53a tempest-SnapshotDependencyTests-1254484672 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.303s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:27 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-01c2beb8-aac6-4dd0-979d-57da5065a53a tempest-SnapshotDependencyTests-1254484672 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:14:27 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0ecc9fae-7a56-4552-8fc1-2a885e2ed4f0 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "cinder-08ad404c-e29c-4e67-84d6-e01d4487baaf-delete_volume" acquired by "delete_volume" :: waited 0.159s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:14:27 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-01c2beb8-aac6-4dd0-979d-57da5065a53a tempest-SnapshotDependencyTests-1254484672 None] Deleted volume successfully.
Sep 18 12:14:27 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-0ecc9fae-7a56-4552-8fc1-2a885e2ed4f0 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:14:27 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0ecc9fae-7a56-4552-8fc1-2a885e2ed4f0 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Acquiring lock "cinder-quobyte-08ad404c-e29c-4e67-84d6-e01d4487baaf" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:14:27 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-01c2beb8-aac6-4dd0-979d-57da5065a53a tempest-SnapshotDependencyTests-1254484672 None] Lock "cinder-8678d98a-3c86-4fc9-a6d2-2d3fdab7ff8b-delete_volume" released by "delete_volume" :: held 1.924s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:14:27 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0ecc9fae-7a56-4552-8fc1-2a885e2ed4f0 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "cinder-quobyte-08ad404c-e29c-4e67-84d6-e01d4487baaf" acquired by "delete_volume" :: waited 0.020s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:14:27 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d319ef2-a324-4dfe-8151-0c59e5a26eb3]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:14:27 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0ecc9fae-7a56-4552-8fc1-2a885e2ed4f0 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-08ad404c-e29c-4e67-84d6-e01d4487baaf {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:27 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-39336345-faae-4b5d-9100-b89e7f0b1817 tempest-SnapshotDependencyTests-1254484672 None] Acquiring lock "cinder-f2eb09f8-ca37-43fe-b692-5250d131c0b5-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:14:27 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-39336345-faae-4b5d-9100-b89e7f0b1817 tempest-SnapshotDependencyTests-1254484672 None] Lock "cinder-f2eb09f8-ca37-43fe-b692-5250d131c0b5-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:14:28 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-39336345-faae-4b5d-9100-b89e7f0b1817 tempest-SnapshotDependencyTests-1254484672 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:14:28 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-39336345-faae-4b5d-9100-b89e7f0b1817 tempest-SnapshotDependencyTests-1254484672 None] Acquiring lock "cinder-quobyte-f2eb09f8-ca37-43fe-b692-5250d131c0b5" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:14:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0ecc9fae-7a56-4552-8fc1-2a885e2ed4f0 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-08ad404c-e29c-4e67-84d6-e01d4487baaf" returned: 0 in 0.617s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0ecc9fae-7a56-4552-8fc1-2a885e2ed4f0 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-08ad404c-e29c-4e67-84d6-e01d4487baaf {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0ecc9fae-7a56-4552-8fc1-2a885e2ed4f0 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-08ad404c-e29c-4e67-84d6-e01d4487baaf" returned: 0 in 0.172s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:28 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-39336345-faae-4b5d-9100-b89e7f0b1817 tempest-SnapshotDependencyTests-1254484672 None] Lock "cinder-quobyte-f2eb09f8-ca37-43fe-b692-5250d131c0b5" acquired by "delete_volume" :: waited 0.224s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:14:28 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0ecc9fae-7a56-4552-8fc1-2a885e2ed4f0 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "cinder-quobyte-08ad404c-e29c-4e67-84d6-e01d4487baaf" released by "delete_volume" :: held 0.891s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:14:28 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc021441-4a92-4379-86b0-05abcabc7897]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:14:28 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-39336345-faae-4b5d-9100-b89e7f0b1817 tempest-SnapshotDependencyTests-1254484672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f2eb09f8-ca37-43fe-b692-5250d131c0b5 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:28 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-0ecc9fae-7a56-4552-8fc1-2a885e2ed4f0 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Created reservations ['5d7d43d4-f561-4a3a-b862-9b935c294234', 'b637bf5a-8ba4-4c62-88e0-b09817bdf079', '5e40ccf4-b812-43d8-b6b1-15e782958503', '145c5e05-b5a0-4004-b64f-83f99f2db04a'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:14:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0ecc9fae-7a56-4552-8fc1-2a885e2ed4f0 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:14:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0ecc9fae-7a56-4552-8fc1-2a885e2ed4f0 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:14:29 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-0ecc9fae-7a56-4552-8fc1-2a885e2ed4f0 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:14:29 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-0ecc9fae-7a56-4552-8fc1-2a885e2ed4f0 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:14:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0ecc9fae-7a56-4552-8fc1-2a885e2ed4f0 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:14:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0ecc9fae-7a56-4552-8fc1-2a885e2ed4f0 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-39336345-faae-4b5d-9100-b89e7f0b1817 tempest-SnapshotDependencyTests-1254484672 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f2eb09f8-ca37-43fe-b692-5250d131c0b5" returned: 0 in 0.663s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-39336345-faae-4b5d-9100-b89e7f0b1817 tempest-SnapshotDependencyTests-1254484672 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f2eb09f8-ca37-43fe-b692-5250d131c0b5 {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:29 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0db67cd2-cbfd-4845-90fe-74c7c08c602e tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Acquiring lock "cinder-c91b144e-de1f-4deb-bd9e-9161d96910ca-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:14:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-39336345-faae-4b5d-9100-b89e7f0b1817 tempest-SnapshotDependencyTests-1254484672 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-f2eb09f8-ca37-43fe-b692-5250d131c0b5" returned: 0 in 0.274s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:29 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0ecc9fae-7a56-4552-8fc1-2a885e2ed4f0 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.506s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:29 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-0ecc9fae-7a56-4552-8fc1-2a885e2ed4f0 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:14:29 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0db67cd2-cbfd-4845-90fe-74c7c08c602e tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "cinder-c91b144e-de1f-4deb-bd9e-9161d96910ca-delete_volume" acquired by "delete_volume" :: waited 0.209s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:14:29 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-39336345-faae-4b5d-9100-b89e7f0b1817 tempest-SnapshotDependencyTests-1254484672 None] Lock "cinder-quobyte-f2eb09f8-ca37-43fe-b692-5250d131c0b5" released by "delete_volume" :: held 1.442s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:14:29 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-0ecc9fae-7a56-4552-8fc1-2a885e2ed4f0 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Deleted volume successfully.
Sep 18 12:14:29 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0ecc9fae-7a56-4552-8fc1-2a885e2ed4f0 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "cinder-08ad404c-e29c-4e67-84d6-e01d4487baaf-delete_volume" released by "delete_volume" :: held 2.697s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:14:29 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-0db67cd2-cbfd-4845-90fe-74c7c08c602e tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:14:30 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0db67cd2-cbfd-4845-90fe-74c7c08c602e tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Acquiring lock "cinder-quobyte-c91b144e-de1f-4deb-bd9e-9161d96910ca" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:14:30 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0db67cd2-cbfd-4845-90fe-74c7c08c602e tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "cinder-quobyte-c91b144e-de1f-4deb-bd9e-9161d96910ca" acquired by "delete_volume" :: waited 0.021s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:14:30 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-39336345-faae-4b5d-9100-b89e7f0b1817 tempest-SnapshotDependencyTests-1254484672 None] Created reservations ['80770b17-1fbb-486a-aa60-8cf285f6fa72', 'e7b624b6-98b0-40fe-9950-f0f6c1ac7125', '16b2bd3d-ee4f-4fba-abc6-3973c578ca48', 'c8999c64-9823-4924-b646-54239bc06025'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:14:30 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a6aa96-d558-4468-b969-7b4321803061]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:14:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0db67cd2-cbfd-4845-90fe-74c7c08c602e tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c91b144e-de1f-4deb-bd9e-9161d96910ca {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-39336345-faae-4b5d-9100-b89e7f0b1817 tempest-SnapshotDependencyTests-1254484672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:14:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-39336345-faae-4b5d-9100-b89e7f0b1817 tempest-SnapshotDependencyTests-1254484672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:14:30 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-39336345-faae-4b5d-9100-b89e7f0b1817 tempest-SnapshotDependencyTests-1254484672 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:14:30 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-39336345-faae-4b5d-9100-b89e7f0b1817 tempest-SnapshotDependencyTests-1254484672 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:14:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-39336345-faae-4b5d-9100-b89e7f0b1817 tempest-SnapshotDependencyTests-1254484672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:14:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-39336345-faae-4b5d-9100-b89e7f0b1817 tempest-SnapshotDependencyTests-1254484672 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0db67cd2-cbfd-4845-90fe-74c7c08c602e tempest-CreateVolumesFromSourceVolumeTest-786174884 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c91b144e-de1f-4deb-bd9e-9161d96910ca" returned: 0 in 0.628s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0db67cd2-cbfd-4845-90fe-74c7c08c602e tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c91b144e-de1f-4deb-bd9e-9161d96910ca {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:30 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-39336345-faae-4b5d-9100-b89e7f0b1817 tempest-SnapshotDependencyTests-1254484672 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.279s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:30 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-39336345-faae-4b5d-9100-b89e7f0b1817 tempest-SnapshotDependencyTests-1254484672 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:14:30 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-39336345-faae-4b5d-9100-b89e7f0b1817 tempest-SnapshotDependencyTests-1254484672 None] Deleted volume successfully.
Sep 18 12:14:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0db67cd2-cbfd-4845-90fe-74c7c08c602e tempest-CreateVolumesFromSourceVolumeTest-786174884 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-c91b144e-de1f-4deb-bd9e-9161d96910ca" returned: 0 in 0.368s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:31 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0db67cd2-cbfd-4845-90fe-74c7c08c602e tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "cinder-quobyte-c91b144e-de1f-4deb-bd9e-9161d96910ca" released by "delete_volume" :: held 1.095s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:14:31 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-39336345-faae-4b5d-9100-b89e7f0b1817 tempest-SnapshotDependencyTests-1254484672 None] Lock "cinder-f2eb09f8-ca37-43fe-b692-5250d131c0b5-delete_volume" released by "delete_volume" :: held 3.306s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:14:31 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-0db67cd2-cbfd-4845-90fe-74c7c08c602e tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Created reservations ['8417aa5c-a62f-4fb8-bac5-57dd47c50e42', 'a2eae0ce-592a-4777-ad79-a61517d9fc9b', 'faed3aff-6677-4222-91b6-eee97f81c8d2', '9483deae-1c1e-4e19-b1d3-7cd5a880996c'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:14:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0db67cd2-cbfd-4845-90fe-74c7c08c602e tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:14:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0db67cd2-cbfd-4845-90fe-74c7c08c602e tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:14:31 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-0db67cd2-cbfd-4845-90fe-74c7c08c602e tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:14:31 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-0db67cd2-cbfd-4845-90fe-74c7c08c602e tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:14:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-0db67cd2-cbfd-4845-90fe-74c7c08c602e tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:14:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0db67cd2-cbfd-4845-90fe-74c7c08c602e tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:31 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-0db67cd2-cbfd-4845-90fe-74c7c08c602e tempest-CreateVolumesFromSourceVolumeTest-786174884 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.130s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:31 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-0db67cd2-cbfd-4845-90fe-74c7c08c602e tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:14:31 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-0db67cd2-cbfd-4845-90fe-74c7c08c602e tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Deleted volume successfully.
Sep 18 12:14:31 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-cde409a5-a480-4e5f-836b-6fbdd7122516 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Acquiring lock "cinder-660acc19-ea7d-4a7d-a6c7-b210bd41b19c-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:14:31 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-cde409a5-a480-4e5f-836b-6fbdd7122516 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "cinder-660acc19-ea7d-4a7d-a6c7-b210bd41b19c-delete_volume" acquired by "delete_volume" :: waited 0.113s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:14:32 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-0db67cd2-cbfd-4845-90fe-74c7c08c602e tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "cinder-c91b144e-de1f-4deb-bd9e-9161d96910ca-delete_volume" released by "delete_volume" :: held 2.340s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:14:32 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-cde409a5-a480-4e5f-836b-6fbdd7122516 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:14:32 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-cde409a5-a480-4e5f-836b-6fbdd7122516 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Acquiring lock "cinder-quobyte-660acc19-ea7d-4a7d-a6c7-b210bd41b19c" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:14:32 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-cde409a5-a480-4e5f-836b-6fbdd7122516 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "cinder-quobyte-660acc19-ea7d-4a7d-a6c7-b210bd41b19c" acquired by "delete_volume" :: waited 0.014s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:14:32 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e39061-b84b-4dec-a676-d85051ff068b]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:14:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-cde409a5-a480-4e5f-836b-6fbdd7122516 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-660acc19-ea7d-4a7d-a6c7-b210bd41b19c {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-cde409a5-a480-4e5f-836b-6fbdd7122516 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-660acc19-ea7d-4a7d-a6c7-b210bd41b19c" returned: 0 in 0.522s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-cde409a5-a480-4e5f-836b-6fbdd7122516 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-660acc19-ea7d-4a7d-a6c7-b210bd41b19c {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:32 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-cde409a5-a480-4e5f-836b-6fbdd7122516 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-660acc19-ea7d-4a7d-a6c7-b210bd41b19c" returned: 0 in 0.129s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:32 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-cde409a5-a480-4e5f-836b-6fbdd7122516 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "cinder-quobyte-660acc19-ea7d-4a7d-a6c7-b210bd41b19c" released by "delete_volume" :: held 0.820s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:14:33 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-cde409a5-a480-4e5f-836b-6fbdd7122516 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Created reservations ['6ddb76c1-9ad1-4629-a378-d21cd5c9e04c', 'a1711880-7085-42ad-8d4a-75a822e21645', 'fe36109d-c719-49b7-893b-92d009b1d981', '5ee7c07a-8039-41cb-af4f-71caca126e7d'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:14:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-cde409a5-a480-4e5f-836b-6fbdd7122516 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:14:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-cde409a5-a480-4e5f-836b-6fbdd7122516 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:14:33 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-cde409a5-a480-4e5f-836b-6fbdd7122516 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:14:33 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-cde409a5-a480-4e5f-836b-6fbdd7122516 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:14:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-cde409a5-a480-4e5f-836b-6fbdd7122516 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:14:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-cde409a5-a480-4e5f-836b-6fbdd7122516 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:33 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-cde409a5-a480-4e5f-836b-6fbdd7122516 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.153s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:33 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-cde409a5-a480-4e5f-836b-6fbdd7122516 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:14:33 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-cde409a5-a480-4e5f-836b-6fbdd7122516 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Deleted volume successfully.
Sep 18 12:14:34 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-efc75f21-8fe3-4399-bfaf-0551ef1d0cbf tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Acquiring lock "cinder-149ec200-1b48-429f-baf0-eebb7ca02d9f-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:14:34 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-cde409a5-a480-4e5f-836b-6fbdd7122516 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "cinder-660acc19-ea7d-4a7d-a6c7-b210bd41b19c-delete_volume" released by "delete_volume" :: held 2.232s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:14:34 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-efc75f21-8fe3-4399-bfaf-0551ef1d0cbf tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "cinder-149ec200-1b48-429f-baf0-eebb7ca02d9f-delete_volume" acquired by "delete_volume" :: waited 0.111s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:14:34 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-efc75f21-8fe3-4399-bfaf-0551ef1d0cbf tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:14:34 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-efc75f21-8fe3-4399-bfaf-0551ef1d0cbf tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Acquiring lock "cinder-quobyte-149ec200-1b48-429f-baf0-eebb7ca02d9f" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:14:34 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-efc75f21-8fe3-4399-bfaf-0551ef1d0cbf tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "cinder-quobyte-149ec200-1b48-429f-baf0-eebb7ca02d9f" acquired by "delete_volume" :: waited 0.013s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:14:34 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1034a18e-3354-4006-8799-eb03ce023fe5]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:14:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-efc75f21-8fe3-4399-bfaf-0551ef1d0cbf tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-149ec200-1b48-429f-baf0-eebb7ca02d9f {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-efc75f21-8fe3-4399-bfaf-0551ef1d0cbf tempest-CreateVolumesFromSourceVolumeTest-786174884 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-149ec200-1b48-429f-baf0-eebb7ca02d9f" returned: 0 in 0.467s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:34 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-efc75f21-8fe3-4399-bfaf-0551ef1d0cbf tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-149ec200-1b48-429f-baf0-eebb7ca02d9f {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-efc75f21-8fe3-4399-bfaf-0551ef1d0cbf tempest-CreateVolumesFromSourceVolumeTest-786174884 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-149ec200-1b48-429f-baf0-eebb7ca02d9f" returned: 0 in 0.102s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:35 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-efc75f21-8fe3-4399-bfaf-0551ef1d0cbf tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "cinder-quobyte-149ec200-1b48-429f-baf0-eebb7ca02d9f" released by "delete_volume" :: held 0.750s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:14:35 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-efc75f21-8fe3-4399-bfaf-0551ef1d0cbf tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Created reservations ['2841af4a-5457-4c52-ae5d-8b6a5cddb93c', 'c7653c9e-520f-4d59-88d6-0e4ef95b3bf8', '5ba8a8d0-b0e0-4f90-9b7c-c365bc89dc90', 'ce43d461-7074-4b7a-b2b3-4eff26b04a2c'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:14:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-efc75f21-8fe3-4399-bfaf-0551ef1d0cbf tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:14:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-efc75f21-8fe3-4399-bfaf-0551ef1d0cbf tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:14:35 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-efc75f21-8fe3-4399-bfaf-0551ef1d0cbf tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:14:35 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-efc75f21-8fe3-4399-bfaf-0551ef1d0cbf tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:14:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-efc75f21-8fe3-4399-bfaf-0551ef1d0cbf tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:14:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-efc75f21-8fe3-4399-bfaf-0551ef1d0cbf tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:35 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-efc75f21-8fe3-4399-bfaf-0551ef1d0cbf tempest-CreateVolumesFromSourceVolumeTest-786174884 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.144s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:35 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-efc75f21-8fe3-4399-bfaf-0551ef1d0cbf tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:14:35 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-efc75f21-8fe3-4399-bfaf-0551ef1d0cbf tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Deleted volume successfully.
Sep 18 12:14:36 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-efc75f21-8fe3-4399-bfaf-0551ef1d0cbf tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "cinder-149ec200-1b48-429f-baf0-eebb7ca02d9f-delete_volume" released by "delete_volume" :: held 2.008s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:14:36 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f0eea11d-d940-474f-8d8f-ff3c1d21977b tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Acquiring lock "cinder-5bcaf56b-3259-4aa2-bb10-982ab95ab12e-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:14:36 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f0eea11d-d940-474f-8d8f-ff3c1d21977b tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "cinder-5bcaf56b-3259-4aa2-bb10-982ab95ab12e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:14:36 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-f0eea11d-d940-474f-8d8f-ff3c1d21977b tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:14:36 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f0eea11d-d940-474f-8d8f-ff3c1d21977b tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Acquiring lock "cinder-quobyte-5bcaf56b-3259-4aa2-bb10-982ab95ab12e" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:14:36 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f0eea11d-d940-474f-8d8f-ff3c1d21977b tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "cinder-quobyte-5bcaf56b-3259-4aa2-bb10-982ab95ab12e" acquired by "delete_volume" :: waited 0.012s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:14:36 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae0e8ec-2c88-4322-9030-665108e297c6]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:14:36 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f0eea11d-d940-474f-8d8f-ff3c1d21977b tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5bcaf56b-3259-4aa2-bb10-982ab95ab12e {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f0eea11d-d940-474f-8d8f-ff3c1d21977b tempest-CreateVolumesFromSourceVolumeTest-786174884 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5bcaf56b-3259-4aa2-bb10-982ab95ab12e" returned: 0 in 0.511s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f0eea11d-d940-474f-8d8f-ff3c1d21977b tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5bcaf56b-3259-4aa2-bb10-982ab95ab12e {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:37 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f0eea11d-d940-474f-8d8f-ff3c1d21977b tempest-CreateVolumesFromSourceVolumeTest-786174884 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-5bcaf56b-3259-4aa2-bb10-982ab95ab12e" returned: 0 in 0.142s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:37 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f0eea11d-d940-474f-8d8f-ff3c1d21977b tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "cinder-quobyte-5bcaf56b-3259-4aa2-bb10-982ab95ab12e" released by "delete_volume" :: held 0.915s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:14:38 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-f0eea11d-d940-474f-8d8f-ff3c1d21977b tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Created reservations ['d7e7b4c7-9140-4abb-9124-bf399e3ce73a', 'c432a123-3e25-4399-a99e-6e667554afdf', '1dafa019-e864-4889-8c87-069a5eb1c3e7', 'c0a6af7b-b02f-4d8b-82a2-8539ab1f9930'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:14:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f0eea11d-d940-474f-8d8f-ff3c1d21977b tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:14:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f0eea11d-d940-474f-8d8f-ff3c1d21977b tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:14:38 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f0eea11d-d940-474f-8d8f-ff3c1d21977b tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:14:38 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f0eea11d-d940-474f-8d8f-ff3c1d21977b tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:14:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f0eea11d-d940-474f-8d8f-ff3c1d21977b tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:14:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f0eea11d-d940-474f-8d8f-ff3c1d21977b tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:38 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f0eea11d-d940-474f-8d8f-ff3c1d21977b tempest-CreateVolumesFromSourceVolumeTest-786174884 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.115s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:38 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-f0eea11d-d940-474f-8d8f-ff3c1d21977b tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:14:38 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-f0eea11d-d940-474f-8d8f-ff3c1d21977b tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Deleted volume successfully.
Sep 18 12:14:38 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f0eea11d-d940-474f-8d8f-ff3c1d21977b tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "cinder-5bcaf56b-3259-4aa2-bb10-982ab95ab12e-delete_volume" released by "delete_volume" :: held 2.192s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:14:39 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f178ac5a-f688-4921-bc8a-bdf2639f2474 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Acquiring lock "cinder-2fa76113-535b-454e-b05b-22812260cdfb-delete_volume" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:14:39 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f178ac5a-f688-4921-bc8a-bdf2639f2474 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "cinder-2fa76113-535b-454e-b05b-22812260cdfb-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:14:39 devstack cinder-volume[83176]: WARNING cinder.volume.volume_utils [None req-f178ac5a-f688-4921-bc8a-bdf2639f2474 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 12:14:39 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f178ac5a-f688-4921-bc8a-bdf2639f2474 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Acquiring lock "cinder-quobyte-2fa76113-535b-454e-b05b-22812260cdfb" by "delete_volume" {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 12:14:39 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f178ac5a-f688-4921-bc8a-bdf2639f2474 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "cinder-quobyte-2fa76113-535b-454e-b05b-22812260cdfb" acquired by "delete_volume" :: waited 0.016s {{(pid=83176) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 12:14:39 devstack cinder-volume[83176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4bd3a0-76e6-4ceb-83e1-90215f32112b]: (4, 'qcow2') {{(pid=84776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 12:14:39 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f178ac5a-f688-4921-bc8a-bdf2639f2474 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2fa76113-535b-454e-b05b-22812260cdfb {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:39 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f178ac5a-f688-4921-bc8a-bdf2639f2474 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2fa76113-535b-454e-b05b-22812260cdfb" returned: 0 in 0.450s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:39 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f178ac5a-f688-4921-bc8a-bdf2639f2474 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2fa76113-535b-454e-b05b-22812260cdfb {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:39 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f178ac5a-f688-4921-bc8a-bdf2639f2474 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] CMD "rm -f /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b/volume-2fa76113-535b-454e-b05b-22812260cdfb" returned: 0 in 0.107s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:39 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f178ac5a-f688-4921-bc8a-bdf2639f2474 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "cinder-quobyte-2fa76113-535b-454e-b05b-22812260cdfb" released by "delete_volume" :: held 0.742s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:14:40 devstack cinder-volume[83176]: DEBUG cinder.quota [None req-f178ac5a-f688-4921-bc8a-bdf2639f2474 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Created reservations ['ba363575-fedf-4fd8-a7f1-58f19cc75f7e', 'd382633c-6fc2-4cfd-915d-09e0efabfe91', 'f655f537-8934-4be3-882d-1d3e6f8e365d', '99180a18-d451-4bc5-82dc-2ac5954e860d'] {{(pid=83176) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 12:14:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f178ac5a-f688-4921-bc8a-bdf2639f2474 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 12:14:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f178ac5a-f688-4921-bc8a-bdf2639f2474 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 12:14:40 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f178ac5a-f688-4921-bc8a-bdf2639f2474 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8': None} {{(pid=83176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 12:14:40 devstack cinder-volume[83176]: DEBUG cinder.volume.drivers.quobyte [None req-f178ac5a-f688-4921-bc8a-bdf2639f2474 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Available shares ['10.10.41.181/cinder-vol-98b328bb-5b8b-46c7-acc6-8407e54a88b8'] {{(pid=83176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 12:14:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.lockutils [None req-f178ac5a-f688-4921-bc8a-bdf2639f2474 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 12:14:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f178ac5a-f688-4921-bc8a-bdf2639f2474 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 12:14:40 devstack cinder-volume[83176]: DEBUG oslo_concurrency.processutils [None req-f178ac5a-f688-4921-bc8a-bdf2639f2474 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/192e7cefe3aeba8637e77309be4dbe7b" returned: 0 in 0.186s {{(pid=83176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 12:14:40 devstack cinder-volume[83176]: DEBUG cinder.manager [None req-f178ac5a-f688-4921-bc8a-bdf2639f2474 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Notifying Schedulers of capabilities ... {{(pid=83176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 12:14:40 devstack cinder-volume[83176]: INFO cinder.volume.manager [None req-f178ac5a-f688-4921-bc8a-bdf2639f2474 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Deleted volume successfully.
Sep 18 12:14:41 devstack cinder-volume[83176]: DEBUG cinder.coordination [None req-f178ac5a-f688-4921-bc8a-bdf2639f2474 tempest-CreateVolumesFromSourceVolumeTest-786174884 None] Lock "cinder-2fa76113-535b-454e-b05b-22812260cdfb-delete_volume" released by "delete_volume" :: held 2.053s {{(pid=83176) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 12:14:50 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:UPDATE=155,cinder:DELETE=14,cinder:SELECT=81,cinder:INSERT=23 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 12:14:51 devstack cinder-volume[83176]: DEBUG dbcounter [-] [83176] Writing DB stats cinder:UPDATE=131,cinder:SELECT=100,cinder:INSERT=41,cinder:DELETE=11 {{(pid=83176) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}